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We present applications of the renormalization algorithm with graph enhancement (RAGE). This analysis 
extends the algorithms and apphcations given for approaches based on matrix product states introduced in 
[Phys. Rev. A 79, 022317 (2009)] to other tensor-network states such as the tensor tree states (TTS) and pro- 
jected entangled pair states (PEPS). We investigate the suitabihty of the bare TTS to describe ground states, 
showing that the description of certain graph states and condensed matter models improves. We investigate 
graph-enhanced tensor-network states, demonstrating that in some cases (disturbed graph states and for certain 
quantum circuits) the combination of weighted graph states with tensor tree states can greatly improve the ac- 
curacy of the description of ground states and time evolved states. We comment on delineating the boundary of 
the classically efficiently simulatable states of quantum many-body systems. 



PACS numbers: 03.67.Mn, 03.65.Ud, 03.67.Lx, 02.70.-c 
I. INTRODUCTION 

Quantum many-body systems show interesting emerging 
properties whose underlying mechanisms are hard to grasp 
but fundamental for the understanding of technological ap- 
plications as well as the conceptual foundations of physics. 
This applies, as far as the former is concerned, for example, 
to properties of superconductivity or of rare-earth magnetic 
insulators; concerning the latter, quantum many-body theory 
has had significant impact to the understanding of the rela- 
tionship between physical descriptions at different scales. To 
gain insight and access to such complex systems, it proved 
useful to identify certain variational classes of states that are 
simple to describe and to analyze (e.g. numerically) and yet 
carry the essential characteristics of the investigated systems. 
Such efforts have been made and carried out successfully for 
one-dimensional systems with renormalization methods. Fol- 
lowing early attempts of real-space renormalization |1|, the 
density matrix renormalization group (DMRG) ||2]-[4l provides 
a framework for the proper identification and treatment of the 
effective low-energy sector of most one-dimensional models. 
An intimate connection between the DMRG and matrix prod- 
uct states (MPS) 1 5 , 6 1 has been identified, in that it has been 
understood that DMRG is a variational method over MPS. In- 
terestingly, quantum information theory and its framework has 
provided a deeper understanding of the essentials behind this 
approach (7] El. 

Following the renormalization idea, many extensions of 
the DMRG concept have been proposed and used success- 
fully for numerical and analytical access to complex sys- 
tems. For instance, the logarithmic corrections of critical 
one-dimensional systems can be described by the multi-scale- 
renormalization ansatz (MERA) |9|. Moreover, to overcome 
the one-dimensionality of the DMRG, tensor-tree states (TTS) 
|[T0V[T4ll have been introduced and successfully applied to sys- 
tems governed by tree-like interaction graphs | HHIll and oth- 
ers. More generally, an arbitrary geometry of the description 



is allowed by projected entangled pair states (PEPS) (191, fol- 
lowing the idea to describe the state of a quantum system by 
suitable projections applied to a highly entangled state. 

Apart from the possibility to describe and to characterize 
a state, it is furthermore essential to be able to compute ex- 
pectation values and other physical quantities in an efficient 
way. While some tensor network states allow for exact calcu- 
lations of local quantities (MPS, TTS, MERA), for others only 
approximate solutions are known. E.g., while the states occur- 
ring in the MERA approach can be efficiently represented as 
PEPS, the former allow for exact efficient evaluations of local 
observables, while the latter generally do not 1201 . 

Besides ground states, also states that evolve in time are in 
the focus of classical simulation. This does not only apply to 
states undergoing time evolution under a local Hamiltonian; in 
the quantum information community, also states that appear in 
intermediate steps of a quantum computation are of interest. 
These states show entanglement features that are essentially 
beyond a one-dimensional renormalization ansatz. However, 
research in quantum information and computation does not 
only offer new problems for classical simulations, but also al- 
ternative ways for the efficient description of quantum states. 

The classification of quantum circuits, whose applications 
modify a given quantum system and its entanglement features 
in a controlled way | 21J|221, gives rise to an according clas- 
sification of quantum states. Some of these states allow for 
efficient descriptions and evaluations, while not necessarily 
agreeing with a renormalization ansatz. An example of such 
states is provided by the so-called stabilizer states 1 23 1, the re- 
lated graph states 1241 l25l and weighted graph states (WGS) 
1261 [27 l. which are constructed by the application of con- 
trolled phase gates and local unitaries to an initially separable 
pure state. 

The lack of an ad hoc choice of an underlying geometry 
in the application of gates provides these states with remark- 
able entanglement features, possibly complementary to those 
provided by renormalization procedures. Under this point of 
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view - and also to assess how useful they are for the descrip- 
tion of physical realizations of quantum information and con- 
densed matter systems - the WGS have been investigated with 
promising results, but the accuracy of the description of states 
could have been improved [ 271 . 

In this work we will study in detail a recent proposal of the 
authors to combine renormalization methods with quantum 
circuits, i.e. to combine tensor-network states and the WGS, 
resulting in the renormalization algorithm with graph en- 
hancement (RAGE), and so called RAGE states |28|. Specif- 
ically, we focus on the question how to improve the tensor- 
network state description of ground states and time-evolved 
quantum many-body systems by a combination with the 
WGS. Extending the results of our previous publication, we 
will use a wider class of tensor-network states in the present 
paper, encompassing MPS, TTS, and PEPS. We provide ap- 
plicable algorithms to compute reduced density matrices and 
to update these variational states in optimization procedures 
efficiently. 

We will first consider different tensor-network states such 
as MPS and TTS. As we intend to apply the RAGE states to 
2D and higher dimensional systems and, generally, systems 
with interaction patterns that give rise to a high amount of 
entanglement, we first investigate the applicability of (bare) 
tensor-network states to this kind of system. An improve- 
ment compared to MPS is expected, as the more general TTS 
allow for a better reflection of the physical geometrical fea- 
tures of the systems to be described. We thereby extend 
prior results by e.g. Shi et al. fTQl and Martm-Delgado et al. 
lHa regarding TTS, as weU as of Refs. |[T0lfT4l fTgHTSll . We 
present a comparative investigation of MPS, TTS (and also 
PEPS) using general analytic considerations as well as nu- 
merical simulations. We describe exactly and approximately 
the ground states of certain graph states, a 2D spin-glass toy 
model and a ID modified Ising model with transverse field 
and a 1/r long-range interaction, respectively. The investi- 
gations clearly demonstate that the TTS can offer an effective 
improvement over MPS for certain state classes e.g. subsets of 
the graph states. However, the numerical simulations indicate 
that the non-linear structure of TTS over the linear structure 
of MPS does not have the significant effect on the achieved 
accuracy in these more realistic condensed matter systems, as 
the improvement is not very strong - such as in case of a 2D 
spin glass - and also the negative impact of the broken sym- 
metry of the TTS description is even stronger sometimes than 
the positive effect of a better connectivity within the tensor- 
network (ID long-range Ising). Hence, in some situations the 
tree-like structure of the TTS makes them favorable for the de- 
scription of models with broken symmetries as well as higher 
dimensional interaction structure, but this is not always the 
case. 

In the main part of the paper, we consider the combination 
of MPS, TTS and PEPS with WGS, and give details of algo- 
rithmic implementations. We use these states for numerical 
simulations of several models, concentrating on condensed 
matter physics (2D Ising, 2D Heisenberg model) as well as 
(random) quantum circuits. The results of these simulations 
indicate that a significant improvement of the accuracy of the 



description can be achieved in some cases. For instance, mod- 
els that have graph states as a ground state typically feature a 
high amount of entanglement which is difficult to describe us- 
ing MPS or similar essentially one-dimensional tensor prod- 
uct states alone. While graph states are naturally included 
in the WGS description, slightly disturbed versions of these 
states (for example, in a model with random local magnetic 
fields) typically are not. As we see in the simulations, a dis- 
turbance can be well described by the tensor product state 
combined with the undisturbed weighted graph-description. A 
prominent example of graph states is the toric code state | 39l, 
whose disturbed case we describe with very good accuracy 
using the RAGE states, as will be shown. Even though, the 
RAGE description has its limits, as for example typical con- 
densed matter systems like the ground state of the 2D Heisen- 
berg model are apparently still to far away from the RAGE 
states to be approximated well with this set. 

The paper is structured as follows. In Section [ll] we will 
briefly describe weighted graph states and their properties as 
well as the tensor tree states used in subsequent investigations 
and augmentation procedures. In Section [III] we will compare 
the MPS and the TTS and give examples, analytically as well 
as numerically, comparing their suitability in the description 
of condensed matter systems with different geometry. In Sec- 
tion [Ivl we will describe how to combine the MPS with the 
WGS, as well as the TTS and the WGS, providing suitable al- 
gorithms adapted for each case. In Section|V]we will then give 
applications of the RAGE class in the search for ground states 
as well as the simulation of quantum circuits. Section |VE 
contains the summary and conclusions. The appendix con- 
tains analogous considerations for the PEPS, in which case no 
numerical simulations were performed, as well as a discussion 
of details of our numerical implementations. 



II. A SHORT SURVEY ON TENSOR-NETWORK STATES 
AND WEIGHTED GRAPH STATES 

In this section we will briefly describe the classes of quan- 
tum states used as fundamental objects in subsequent investi- 
gations and augmentation procedures. We describe the matrix 
product states (MPS), tensor tree states (TTS), projected en- 
tangled pair states (PEPS) and weighted graph states (WGS). 
We give the applicable algorithms to compute reduced density 
matrices and to update these variational states in optimization 
procedures. 

We will first focus on tensor-network states. These states 
obtain their name from a correspondence to a network, i.e. a 
graph consisting of vertices and edges. The correspondence 
can be established as follows. A multi-partite state vector of 
qudits I V^) can be written in a product state representation with 
local bases where z = 1, . . . , A/" and Si = 0, . . . , i^ — 1, 

as 



E - 

si ,...,Siv=0 



(1) 



The symbol A is a tensor of rank N with indices of dimen- 
sionality q. Hence there are complex numbers defining 
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the tensor, and thus, the state. The tensor A may now arise 
from a contraction of other tensors, e.g. 



A - V 4(1) 4(2) .(3) 

q;,/3,7 



(2) 



where each tensor can be identified with a vertex in a graph. 
The Greek indices, which are summed over, define a connec- 
tivity relation of the tensors. They can hence be identified 
with edges in a graph where the tensors correspond to ver- 
tices. Usually, the local quantum systems are identified with 
vertices as well, characterized by only one edge connecting to 
them. 



A. Matrix product states 

The class of matrix product states - then referred as as 
finitely correlated states and expressed in the Heisenberg pic- 
ture for infinite lattices - was introduced in Ref. |5 |, in work 
that also provided a thorough analysis of their correlation and 
entanglement properties. Later investigations revealed that 
DMRG numerical methods can indeed be viewed as varia- 
tional methods based on MPS as ansatz states and the suc- 
cess of DMRG regarding the numerical simulation of one- 
dimensional quantum spin systems was understood from sev- 
eral perspectives, see e.g. Refs. |7 , 8 1. What is more, the good 
performance of DMRG is related to the insight that ground 
states of local Hamiltonians satisfy so-called entanglement 
area laws |[30H38]| and are expected to contain in a sense little 
entanglement even for critical models. For a recent compre- 
hensive review, see Ref. | 30| ; for a discussion in the context 



of the present work, see Section III Let us start by giving a 
brief definition of MPS. 



1. Definition and notation 

There are two kinds of MPS, one having open and one 
having closed boundary conditions. Using a product basis 
. . . , Sat)}, with Sj = 0, 1, an A^-spin or qubit MPS vec- 
tor with closed boundary conditions is defined as 



MPS, closed/ 



si ,...,s_/v=0 



\si, . . .,sn). 



(3) 

In contrast, an A^-spin MPS vector with open boundary con- 
ditions is defined as 



with the entanglement features of tensor tree states (TTS) is 
presented. 



2. Evaluation of observable s in MPS 

The following algorithms are applicable to the MPS but are 
neither new nor the most efficient implementations possible. 
They, however, form the basis for the algorithms in the cor- 
responding RAGE states. Expressing a state as an MPS with 
a small value of D allows for an efficient computation of re- 
duced density matrices with small support. Consider a closed 
boundary matrix product state vector | V^mps, closed), see Eq. ([3]), 
and let us define the transfer matrices 



E 



A 



(5) 



where * denotes complex conjugation of the elements of the 
matrix. The reduced state with support on sites in the subset 
S := {mi, . . . , m\s\} C {1, . . . , N} with complement S is 
then found to be 



PS 



tr^ [|'0MPS,closedX'^MPS, closed 
1 



E 



tr 



SI,. ..,3^=0 

ri ,...,r Ar=0 



X tr^[|si,...,5Ar)(ri,...,rAr[ 



E 



tr 



(6) 



' rn\s\ I 



where 



(n) 



in) 



neS 
neS 



(7) 



For an A^-qudit system with local physical dimension q, the 
effort to compute ps scales as 0{\S\D^q'^^^^), as for each of 
the g'^l'^l elements in the reduced density matrix we have to 
multiply of the order of \S\ matrices of dimension D'^ x D'^, 
with an initial effort of 0{ND^) to precompute the product of 
the matrices with support in S. As the number of matrix 
elements grows exponentially with the support of the reduced 
density matrix, only operators with small support, as the phys- 
ically motivated type of Hamiltonian given above, are to be 
considered. 



3. Variational methods in MPS 



I^MPS, open) = E ^^^'M^'J " • ■ ^l^I^^^l^^ l^l, ^2, • • • , ^iv) 
Si ,...,Siv=0 

(4) 

Here, the symbols Ai^^\ with values j = 0, 1, . . . , A/" — 1, de- 
note complex DxD matrices, and the symbols ai\^ as well as 
ai^^ denote complex I^-dimensional row and column vectors, 
respectively. For a discussion of the entanglement features of 



MPS, please see Section III where an analysis in comparison 



• Any MPS can be interpreted as a linear superposition of 
other MPS, where the linear superposition is controlled by the 
elements of one of its matrices that can be chosen arbitrarily. 
This dependence can be used to update matrix entries in order 
to optimize expectation values or overlaps. Consider writing 
the MPS in the form 



MPS, closed 



k,l,Sn 



(8) 
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using another set of MPS defined by 

Hk, I, s„)) := Yl [41) . . . D{k, . . . 

x\si,...,sn), (9) 



Si , . . . ,Sn, ,. . . ,S_/v 



where 



D{k,l) 



k,l 



(10) 



This Hnear dependence of the MPS on its matrix entries and 
the reformulation of the original MPS into a superposition of 
other MPS makes it possible to efficiently compute a new rep- 
resentation of any operator with small support as a quadratic 
form over the entries of the vector A. For example, a Hamil- 
tonian H is transformed into a matrix H, where the triples 
/c, / , Tn of indices are combined into one index (/c, / , r^), etc., 

Hik,i,rr,),ik',i'yj •= {l^{k,l,Sn)\H\ii{k' ,1' ,s'^)). (11) 

Analogously, a new representation of 1 is obtained such that 
the energy can be written as a Rayleigh quotient 



-H-A 



(12) 



where - if the matrix A belongs to site n - it can equally be 
regarded as a vector with elements 



^{k,l,Sr^) '= {^^Z^)k,h 



(13) 



which we simply give the same symbol as the meaning is clear 
from the respective context. The extremalization of the ex- 
pression in Eq. ([12]) with respect to the entries in the vector 
a and hence in the matrices A^^^ corresponding to a site n 
can be achieved with linear algebra methods and essentially 
amounts to a generalized eigenvalue problem. A sequence of 
MPS, monotonously approaching an extremal point (e.g. the 
ground state) can be computed by iterating the procedure over 
all values of n repeatedly. While this effectively amounts to 
solving a global optimization method by iterative local solu- 
tions, this method produces extraordinarily high accuracy in 
practice. Efficient algorithms for the case of open boundary 
MPS will be given in the next section, as these states are a 
special case of tensor tree states (TTS). 



B. Tensor tree states 

Recently Shi et al. ifTOl showed that open boundary MPS 
(see Eq. (|4])) are a special instance of a more general class of 
states, the tensor tree states, a description of states in terms 
of a tensor-network with tree structure, see also Refs. |[mi4Ql 
I4TII . This class retains the favorable properties of MPS, in 
particular the ability to describe slightly entangled states, the 
possibility to update the description when such states evolve in 
real or imaginary time and the possibility to extract informa- 
tion from these states. We follow this approach and consider 
the description of states using a tree graph as the underlying 
network. 




FIG. 1 . (Color online) Subcubic tree representing a six-qubit quan- 
tum state. 
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FIG. 2. (Color online) Tensor network representation of MPS with 
open and closed boundary conditions. 



1. Definition and notation 

Tensor tree states are tensor-network states where the net- 
work is a tree graph. In particular, (i) the leave nodes of the 
tree represent the local physical systems (d-level spins), (ii) 
a star- shaped graph with k edges represents a tensor with k 
indices, (iii) there are no loops in the graph, and (iv) edges in 
the graph represent indices shared by the corresponding ten- 
sors represented by the vertices and will be summed over. An 
A^-qubit state in the computational basis is represented by a 
single tensor with N indices, which can be obtained from any 
other tensor-network by performing all the different contrac- 
tions. An important example of a tree is the so called subcubic 
tree, as depicted in Fig.[T] In a subcubic tree, the leaf- vertices 
have rank one, and all the other vertices rank three. The state 
vector represented by the tree in Fig. [T] is correspondingly 



x-i 



d-l 



Ck:i,2,Ck;i,3,Q!i,4=0 Si,S2,.--)<56=0 

X Ai3)^/'^MW:-^«|si,...,S6), (14) 

or, if one singles out an arbitrary tensor, say A^^\ the same 
state vector can be written as 

x-i 

IV^TTS) = ^LV,2,«l,3,«l,4l^«l,2)l^«l,3)l^«l,4)' 
ai,2,Q;i,3,Q!i,4=0 

(15) 

where |(/:?^^ . ) is the part of the state with support on the spins 

connected to A^^^ via the index ai ^, and similar for the other 
states of this kind. Note that these states are represented by 
subgraphs of the graph representing the whole TTS. 

Consider the special case of an open-boundary MPS, so a 
state being defined by an ID tensor network: Let us write the 
state corresponding to Fig. [2|a) and show that it is an MPS 
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with open boundary conditions. The state vector correspond- 
ing to the given graph is 



D-l 



d-1 



I^MPS) 

ai,2Q!2,3---a(7V-i)iv=0 si,...,Siv=0 

4'!X3<2-^,J^i'---.^^)- (16) 

If we define the vectors 

(aW)fc = {A^'>^h, (aW)fc = (17) 
and the matrices (tensors with two indices) 

(4^;)),,, = {A^'>^)k,i, (18) 

fori G {2, 3, . . . , A/" — 1}, each coefficient (si, . . . , satIV^mps) 
of the state vector is given by the product of matrices 
As2^ As3^ . . . As^Ii^^ multipHed by the row vector ai^^ from 

the left and by the column vector a^^^ from the right. We 
obtain 

d-l 

|V'MPs)= J2 a^^jAgK..ai^J\s„S2,...,SN), 

(19) 

which is an MPS with open boundary conditions as claimed. 
For a discussion of the entanglement features of TTS, please 



see Sec. Ill where an analysis in comparison with the entan- 
glement features of MPS is given. 



2. Evaluation of observable s 

In this subsection we show how to evaluate product observ- 
ables in an efficient way. Note that in particular the ability to 
compute sums of product observables allows us to compute 
the energy of a system described by a Hamiltonian that can be 
written as a sum of bilocal terms, e.g. 



H 



(a,6) 



{a,6}G£: 



(20) 



where 8 denotes the set of pairs of spins connected by an in- 
teraction. Note that several interesting Hamiltonians such as 
the Ising or the Heisenberg Hamiltonian are of this form. Con- 
cerning our notation, as in the example Hamiltonian above, we 
will write a local operator O, acting on a multi-particle system 
with support on, say, site a as O^'^^ := 1 (g) • • • (g) O (g) • • • (g) 1. 
Correspondingly, we will write two-local operators as O^^'^^ 
etc. 

Let |?/;TTs)beanA/'-qubitTTS,andO = Oi^02^- ■ -^On 
a product observable. We want to compute the expectation 
value (V^TTs|0|V^TTs)- The applicable algorithm is a recursive 
one, starting with an arbitrary edge a that is not connected to 
a leave. The edge defines a natural bi-partition of the system 
into the parts L and corresponding to the subtrees con- 
nected by the edge. Following the definition of the TTS, we 
can write the expectation value with respect to the index a as 



(V^TTS|0|V^TTS) 



{^a'm^-^){^^^0^\^^), (21) 



where (O^) is the part of the observable acting on 
\^a) (\^a))- Let US write the left bracket explicitly, and 
let be the tensor connected to edge a and belonging 
to the subtree L. Using this definition, we obtain \(p^) = 

E/3i,/32 ^a,/3i,/32l^k)l^l2)- Hence a recursion arises via the 
relation 

I3i,l32,l3{,p'2 

{^l,\0^-\^\){^\\O^^Wl:), (22) 

which - in a straightforwardly generalized manner - is valid 
for all consecutive levels in the tree. The recursion is termi- 
nated if an expression of the kind ((/:?^^ |0^2 1(^2^^ amounts to 

the expectation value of a local system, i.e. if \^'^^^) = \sn) for 
some local system \sn)- 

The computational effort of this contraction is of order 
0{TD^) where T is the number of tensors, which is of the or- 
der O(A^), provided that subtree expectation values are cached 
and reused in the recursion. 



3. Variational methods 

The treatment of TTS is very similar to the treatment of 
MPS. The energy can be expressed analogously as a Rayleigh 



quotient, see Eq. 
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However the matrix elements of H are 
given by an expression adapted to the slightly different tensor 
network structure. Choosing an arbitrary tensor A and writing 



Q!,/3,7 



(23) 



accordingly, we now have 



J?(a',/3',r)(a,/3,7) := {^U{4^{^UH\V>IMM) , (24) 

and similarly for 1, see also Appendix [a[ 



C. Weighted graph states 

Weighted graph states (WGS) |ESl27 | are a generalization 
of graph states (241 |25l. Both are multi-particle states de- 
rived from a graph whose vertices are identified with spins 
and whose edges correspond to (controlled) phase gates. 



1. Definition and notation 

A graph state corresponds to a graph G = (V^E) of ver- 
tices V and edges E. The graph implies a construction rule 
for a quantum state: We start with a set of A/" = |V| quan- 
tum sites, one quantum site corresponding to exactly one ver- 
tex in the graph G. Initially, the quantum sites are prepared 
to be in the product state vector |+)*^^, and then, following 
the connectivity in the graph, a phase gate diag(l, 1, 1, —1) 
is applied to two quantum sites whenever the corresponding 
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vertices are connected by an edge. A prominent example of 
such graph states is the 2D cluster state | 21 1, corresponding to 
a two-dimensional rectangular lattice with phase gates acting 
on nearest neighbors. 

A generalization of this contruction is given by the 
weighted graph states, where each phase gate can be a unique 
controlled phase gate. Accordingly, a weighted graph state 
vector is given by 

\^g)= I n ^4:^ 1 1+)^"^' (25) 
\{aMeE J 

where 

AZ^^ , =diag(l, 1,1,6^-^-^/2) . (26) 

Note the factor 1/2 in the exponent, corresponding to a 
twofold application on each gate each pair, as we do not limit 
the application to pairs a < b, which is often found in the 
literature. 

A (weighted) graph can be described by a matrix, its adja- 
cency matrix with entries 

\(Pa,b if a and 6 are connected by (/:?a,6 
^^^^-'^ = |o otherwise '^^^^ 

where in a non-weighted graph state, the angles are given by 
either or 1. Both the rows and the columns of the matrix 
correspond one-to-one to the vertices in the graph - and hence 
to the sites of the quantum many-body system. 

Non- weighted graph states have another important interpre- 
tation. They are the common eigenstate with eigenvalue 1 for 
the set of commuting operators given by 

i^, = <a^ :=< n al (28) 

beNa 

where a denotes a vertex and Na is the set of vertices con- 
nected to vertex a via an edge. The operators Ka form a com- 
plete set of commuting operators, comparable to the complete 
set of commuting observables characterizing the pure states of 
other quantum mechanical systems. 

2. Entanglement features 

Unlike MPS and TTS, the WGS bear no ad hoc inherent 
geometrical relations and can hence be used to describe states 
arising from any interaction pattern. Hence each pair can be 
treated on equal footing and no preference of any geometric 
relation between individual sites is assumed nor implied. 

For example, the WGS may possess an arbitrarily high 
amount of entanglement insofar as the entanglement between 
any block of Na particles and the rest of the system may scale 
with the volume of the block i.e. with the number Na of con- 
tained particles. In particular, the WGS are able to fulfill an 
area law |30|, and thus weighted graph states satisfy a con- 
dition which is necessary to approximate the ground state of 
many lattice spin systems. The set of weighted graph states 



contains the two-dimensional cluster state, which was shown 
to maximize the amount of entanglement under several differ- 
ent points-of-view (see, e.g. Ref. Wfl ). Moreover, the corre- 
lation length within the WGS may diverge |46|. 



III. A COMPARISON OF MATRIX PRODUCT STATES 
AND TENSOR TREE STATES 

A. Discussion 

The RAGE states are a composition of tensor-network and 
weighted graph states. Before investigating the features of the 
resulting composite class of states, its features and applicabil- 
ity, it is useful to first analyze both kinds of states individually 
and see what their respective characteristics are. Thus, in this 
section, we first investigate the applicability of (bare) tensor- 
network states such as MPS and TTS to describe systems with 
particular entanglement characteristics. As we are interested 
in 2D and 3D systems and, generally, systems with interaction 
patterns that give rise to a high amount of entanglement, we 
concentrate on this kind of system. 

Since MPS are at the core of a very successful numerical 
method, the density matrix renormalization group (DMRG) 
method, it is an intriguing question whether the use of TTS, 
which are a superset of the MPS, may offer advantages for 
numerical methods. More precisely, we may ask: Given a 
Hamiltonian, is there a TTS that can approximate the ground 
state of this Hamiltonian more accurately than an MPS, while 
using the same number of parameters? And, moreover, when 
the system size grows, does the number of parameters in the 
TTS description grow more slowly compared to an MPS de- 
scription of the state, for a desired accuracy? Unsurprisingly, 
these questions are related to the entanglement of the system 
and its scaling. In this spirit we will first construct a specific 
example where general TTS seem to be the better choice. This 
example should serve as a motivation why we include TTS 
into the RAGE class later and not merely MPS. 

As shown in Ref. |5 |, the Schmidt rank x of a state is the 
quantity that tells us how efficiently MPS can describe this 
state. Any finitely sized state can be written as an MPS, pro- 
vided that the matrix dimension D, limiting the Schmidt rank 
X of the MPS strictly, is sufficiently large. Hence, a small 
Schmidt rank asserts a good description with small matrices. 
While it gives the right picture, this criterion is very strict, 
and can be relaxed by a consideration of the Renyi entropy 
instead. For a refined discussion, see Ref. |38|. Characteriz- 
ing the entanglement properties of systems to be described is 
hence important to estimate the possible fidelity. Important is 
the growth of the entanglement with the system size. The fact 
that an area law holds means that the Renyi-entropy of the 
reduced state of a subset of sites is proportional to its surface 
area. Such an area law has been proven to govern the ground 
states of many interesting physical systems, see Refs. 13QK361 . 
However, an area law neither holds for (i) ground states of in- 
teracting systems with interactions that are too slowly decay- 
ing with distance, nor for (ii) ground states of critical systems, 
where the entropy of entanglement generally does not saturate 
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but grows logarithmically with the system size at least in ID 
systems |29J, nor for (iii) some time-evolved systems: If one 
allows the time to grow with the block size that is being con- 
sidered 1 48, 49 1 . Otherwise, an entanglement area law holds 
for all times |50, 51J. 

In a TTS description, we have the following situation. A 
quick glance on Eqns. ( [Al| ) and ( |A4| ) in Appendix [A| shows 
that, in case the two subsystems are connected by a single 
edge, the Schmidt rank is limited by the value of the index 
dimension D of the edge. Hence for a subsystem A connected 
to the remainder of the system by a single edge in the graph 
the entropy of entanglement of the reduced state is limited by 
S{pa) = log2 D. More generally, each edge connecting two 
subsystems represents one ebit (carrying I^-levels) of possible 
entanglement between the systems. Although there are bi- 
partitions that imply cuts through several edges in the graph 
and hence have a possibly larger entanglement, the maximum 
entropy of log2 D between bi-partitions along an edge renders 
the TTS (as the MPS) inefficient for the simulation of ground 
states of spin systems whose interaction graphs are essentially 
two- or higher dimensional. 



B. Analysis of an advantageous TTS description 

For a more thorough investigation of the TTS description, 
the Schmidt rank must be replaced by another measure known 
from graph theory, the Schmidt rank width Xwd- Its definition 
implies a minimization over all possible trees T, which are 
describing the system 152] 

Xwd(IV^)) := rmnmaxlog2XA|, (29) 

where Xa^,b^ is the Schmidt rank of the bi-partition one ob- 
tains by deleting edge e from the tree T. Another measure 
is the entanglement width E^^ defined similarly, except that 
\og2 Xa^,b^ is replaced by the bi-partite entanglement en- 
tropy Ea^,b^ . In general the relation 

Xwd > ^wd (30) 

holds 15211 . 

While a favorable TTS description possibly exists, the 
tree that actually achieves the task is hard to compute. For 
graph states, however, efficient algorithms are known, see 
e.g. Ref. |[52j[53l, where the most efficient tree (up to a con- 
stant factor overhead) can be derived from the stabilizer de- 
scription of the state. In this light is possible to construct ex- 
amples where TTS are better suited than MPS. One instance 
is the following interaction model. Any non- weighted graph 
state has the property to be the common eigenstate with eigen- 
value 1 for the all operators 

i^, = <a^ :=< n al (31) 

beNa 

where a denotes a vertex and Na is the set of vertices con- 
nected to vertex a via an edge. Hence, a Hamiltonian with 
local interaction terms of the type — ai^^ IlbGA^ ^^^^ above 




FIG. 3. (Color online) Tree graph state (top part) and specific ar- 
rangement (or labeling) of the qubits (bottom part) for an MPS de- 
scription of the state. Qubits of the graph state and graph state in- 
teractions are shown in dark colors, while the MPS tree and points 
representing matrices are shown in light colors. One bi-partitioning 
is shown. The entropy in this case, according to the rules described 
in the text, is 2 ebits. 



has a ground state which is a graph state. We consider an inter- 
action like above taking place on a tree graph, with arbitrary 
interaction strengths, and possibly also additional magnetic 
field terms. Without the latter, the ground state of this sys- 
tem turns out to be a graph state, see Ref. 124^, 25J, where the 
corresponding graph is given by the tree structure specifying 
the interaction pattern. As shown in Ref. f52l, such a graph 
state can be described by a TTS rank 2 only, independent of 
the number of particles involved. Consequently, there exists a 
TTS description in which the tensor dimensions do not have 
to grow with the system size but can stay constant. Since one 
needs 0{N) tensors to describe the state - independently of 
the geometry of the tree underlying the TTS description - the 
total number of parameters, as well as the effort to compute 
expectation values in these states, scales as 0{N). 

On the other hand, one can show that a description in terms 
of a MPS requires matrix dimensions of up to Xmps N^^'^, 
which is increasing in an unbounded fashion with system size, 
although only polynomially. We would like to give an intuitive 
argument at this point, without formal proof, to rule out the 
possibility of an efficient MPS description. To do so, we give 
an intelligent guess about a good MPS tree and argue why it 
is already the optimal one. 

We proceed as sketched in Fig. |3] The tree graph state is 
flattened i.e. we label the qubits in the order in which they ap- 
pear when we move each single one down to the base line in 
the top part of Fig. [3] The MPS tree used to describe the state 
is sketched in the third dimension in the bottom part of the 
figure. The dimensions of the MPS matrices are determined 
by the Schmidt rank or the entropy of the chain's bi-partitions 
that are of the type "right block vs. left block". One can easily 
read off the maximum entropy of such bi-partitions by count- 
ing the black arches (graph state interactions) which are being 
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cut by a vertical line specifying the bi-partition. All except 
one arch emerging from some specific qubit must be ignored. 
In this way one finds that there are some bi-partitions with 
\d/2 \ ebits where d is the depth of tree corresponding to our 
tree graph state. Since N ^ 2^ this number translates into 
MPS matrix dimensions of size at least A^^/^ x A^^/^. Hence, 
for any such matrix we need 0{N) parameters. A counting 
argument shows that the number of matrices with this dimen- 
sion also grows with A', specifically like A"^/^. Hence, the 
total number of parameters for an MPS description with our 
chosen tree scales at least like A"^/^ as compared to a linear 
scaling that a more general TTS can achieve. 

To show that the chosen MPS tree is the optimal one we 
would have to verify that (i) no rearrangement of any sub- 
set of qubits would lead to smaller entropies and hence to 
more favorable matrix dimensions and, even if this was the 
case, that (ii) no rearrangement can lead to the situation that 
the number of matrices that need 0{N) parameters becomes 
a constant,/.^, independent of A^. Any rearrangement of the 
qubits, unless it is a trivial one due to symmetries of the tree, 
will usually increase the number of interaction arches that bi- 
partitioning vertical lines cut. There are non-trivial rearrange- 
ments that do not increase this number, but these cannot lead 
to the situation described in (ii) as this would require that the 
interaction arches pile up above few qubit pairs, which is in- 
compatible with the tree structure of the graph state. 



C. Numerical simulations 

In this subsection, we give the results of numerical simula- 
tions performed with MPS and TTS. We choose spin models 
that are usually hard cases for an MPS description and feature 
long-range, or two-dimensional, or broken- symmetry interac- 
tions. We show that in some cases the TTS, which can be 
adapted to non- symmetric interaction patterns, perform better 
than the chain-like MPS. 

The models were selected as they might show features rel- 
evant for the description of condensed matter systems while 
they are at the same time expected to be well suited for a tree 
description. For some very specific interaction models, as in 
the case of dendrimers (this is a different kind of tree structure 
where all tensors correspond to a physical particle), the highly 
adapted TTS description already proved to reflect the physical 
situation well and achieved an accordingly good approximate 
description of many physical features of the system. 



1. A model with broken interaction symmetry 

The first numerically investigated case are spin glasses. As 
can be seen from this example, we find that for inhomoge- 
neous systems the TTS are in some cases better suited to de- 
scribe a state, as they can be adopted to the broken transla- 
tional symmetry. More precisely, we considered interactions 
of the anti-ferromagnetic Heisenberg type. We chose statisti- 
cally distributed interaction strengths between next neighbors 
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FIG. 4. (Color online) Spin-glass, 16 sites. Depicted is the achieved 
accuracy when approximating the ground state with MPS and TTS. 
We find that for a small number of parameters used in the description 
{i.e. to signify the tensor entries), the sub-cubic tree describes a sys- 
tem better than the MPS. The situation is reversed for a large number 
of parameters. 

in a two-dimensional setting and with open boundary condi- 
tions. The model hence is described by the Hamiltonian 

where Jij follows a Gaussian distribution with mean 1 and 
sigma 0.1 and where (i, j) denotes nearest neighbors in a 
two-dimensional rectangular lattice. Spin sites that interact 
strongly are chosen to be represented by leaves that are con- 
nected closely in the tree. Since it is impossible to reflect the 
closeness relation consistently for all sites, a compromise has 
to be made (see below). Generally, a priori considerations can 
be made of how certain properties of the model carry over 
to the entanglement structure of the state. These properties 
can be geometry-related (in real space or also in momentum 
space) or depend on details of the interaction itself. Besides 
considerations regarding the geometry of lattice models and 
the impact of neighborhood relations on correlations in short 
and long range interaction scenarios |[T6l[54l[55l, also typical 
electron correlations in certain models of quantum chemistry 
are subject to this kind of analysis (561 [57l. An optimal choice 
of topological properties (correspondence between items in 
description reality, geometry) of the MPS or TTS graph can 
then be derived, taking into account e.g. the von Neumann 
entropy. 

The computational results for the search of the ground state 
energy of these systems are demonstrated in Fig. |4] We find 
that for a small number of parameters used in the description 
(i.e. to signify the tensor entries), the TTS with sub-cubic tree 
structure describes a system better than the MPS. We remark 
that a similar behavior is also observed for certain regular sys- 
tems (see below), however in these cases (as well as in the 
present example) the situation is reversed for a large number 
of parameters. 

This scaling behavior is due to the interplay of two concur- 
rent effects. First, the number of edges between subsystems 
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FIG. 5. (Color online) Modified Ising ID, open chain, length 24, 
transverse field B = 1, cr^cr^— coupling with strength 1/r. Depicted 
is the achieved accuracy when approximating the ground state with 
MPS and TTS. Although the MPS are not suited to carry long range 
entanglement, they perform better than the sub-cubic tree, due to the 
fact that the tensor tree ansatz breaks the (translational) symmetries 
of the Hamiltonian explicitly 



(connectivity) plays a role, as in MPS and TTS states corre- 
lations decay quickly over distances in the graph. Hence, in 
the case of nearest neighbor interactions, where close parti- 
cles show often higher correlations than remote ones, the spin 
system is best described by reflecting the spatial closeness of 
physical sites by a closeness of the corresponding vertices in 
the graphical description. Thus, the connectivity favors the 
subcubic tree description, as the average number of edges be- 
tween two sites is smaller there than in the flat tree description. 

Second, the bi-partite entanglement as measured by the 
Schmidt number grows merely as I), if the bi-partition of the 
state is performed by cutting an edge. Often, geometric effects 
are less influential than the scaling of the overall parameter 
count with D.lna. tree, the number of parameters goes as D^, 
whereas in an MPS description it grows as D'^. At some point, 
as the numerical simulations show, the different abilities of the 
different descriptions to adapt to the geometry of the model is 
overcome by the better scaling of the entanglement content in 
the simple MPS description. 



low dimensional MPS are not suited to carry long range en- 
tanglement, which is expected to occur in a system with such 
a Hamiltonian, in this model MPS always perform better than 
the sub-cubic tree. Note in this regard that the tensor tree 
ansatz breaks the (translational) symmetry of the Hamiltonian 
explicitly. The considerations made above in the context of 
the two-dimensional spin-glass apply also here. 

For a related study of linear systems under long-range inter- 
action as found in quantum chemistry models, see Ref. 1551 . 



IV. COMBINING TENSOR-NETWORK STATES WITH 
WEIGHTED GRAPH STATES 

In this section, we want to consider in detail the renor- 
malization algorithm with graph enhancement (RAGE). This 
improved renormalization algorithm corresponds to a varia- 
tional state class, the RAGE states, which are a combination 
of tensor product states and WGS. In the next sections we will 
give variants of RAGE states that correspond to certain special 
cases of tensor-network states. In the following we will dis- 
cuss RAGE states based on MPS and TTS, as well as general 
tensor network states. The implementation is slightly different 
in each case, adapted to the underlying tensor network struc- 
ture. 



A. RAGE states based on MPS 

RAGE states based on MPS have been introduced in 
Ref. |28|. We will now review the construction given in the 
same reference and provide additional details and discussions. 
For simplicity, clarity and to stress the connection to the al- 
gorithms given in the previous sections, we will restrict our- 
selves to the case where the spin-dimension is q = 2 first, 
which is however easily generalized. Related results will be 



given in Sec. |IVC[ in a modified form designed especially 
for the treatment of TTS and hence also open-boundary MPS, 
where moreover the applicable algorithms will be given ex- 
plicitly for higher dimensional spin systems. 



2. A chain with long-range interaction 



1. Definition and notation 



The second case we consider is a modified Ising model with 
transverse magnetic field and long-range interactions that de- 
cay as 1/r. More precisely, we look at a chain governed by 
the Hamiltonian 



H 



N 

E 



1 



N 



■(i) 



(33) 



with = 24. The configuration chosen for the spin sites in 
the sub-cubic tree followed the idea developed above, i.e. sites 
that interact strongly are chosen to be close in the tree. 



We start from closed-boundary MPS of a quantum chain of 



length N, consisting of 2-level systems, as in Sec. |II A 

\^{A)) :- 



E 



tr 



si,...,SAr=0 



where the are complex D x D matrices. 

Now we consider the adjacency matrix (fofa. weighted sim- 
ple graph with (p^^i G [0, 27r) and apply the corresponding 
phase gates AZ{(pk^i) between the particles /c, / in the chain. 



\si,...,sn) (34) 
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Finally, we apply local rotations Vj G U{2), to arrive at the 
variational class of states defined by 



N 



J2 tr[AW...AW] (35) 



which then forms the basis of the renormalization group algo- 
rithm with graph enhancement based on MPS. For simplicity, 
and w.l.o.g., we will often set Vj = 1 subsequently. 



2. Relationship with MPS and WGS 

The RAGE states encompass both the MPS and WGS, and 
more. The MPS are included by definition, using (/p = and 
Vj = 1. The inclusion of WGS is revealed by rewriting the 
expression from Ref. 1271 



N 



m j=l 
1 



Si ,...,SAr=0 



(36) 



N 



3 = 1 k,l 



\Vm,N), 



where = {dm,i, • • •.dm.N), s = (si, . . .,Sn), |^m,n) 
|0) + e'^"^ '^ |1) and AZ((/p^ are defined as above. 



3. Properties 

The RAGE states inherit and combine the properties of 
tensor product states and WGS. They have a polynomially 
sized description, where (in the present case) the MPS and 
the WGS part are fully determined by 0{ND'^) and 0{N'^) 
real parameters respectively. Moreover, like the WGS, the 
RAGE states allow for long-ranged correlation and a volume 
law for the entanglement entropy. By having a collection of 
maximally entangled qubit pairs across a boundary, the von- 
Neumann entropy of a block of size L can be taken to scale 
SiS S{pl) = 0{L). Encompassing graph states, our class can 
hence maximize the entanglement entropy. 

The given description of states allows for a manifest trans- 
lational invariance. Whenever the MPS part is translationally 
invariant, (/p is a cyclic matrix, and Vj is the same for all j, 
the whole state \(p) is translationally invariant. There exist 
other translationally invariant states that do not have this sim- 
ple form. The key feature is that there exists this natural sub- 
set of states for which translational invariance is guaranteed 
to be exactly fulfilled, while at the same time a volume law 



for block- wise entanglement is possible ||46j[5S|. Finally, as 
MPS already form a complete set in Hilbert space (if one al- 
lows D to scale as 0(2^), one can represent any pure state in 
(C^)^^) and this remains true for the RAGE set. 



4. Efficient computation of local properties and correlation 
functions 

The previous properties are all very natural and desirable, 
and especially a volume law for the entropy of reduced sys- 
tems cannot be achieved efficiently with MPS alone. How- 
ever, as will be shown, this does not prevent us from com- 
puting local properties and correlation functions efficiently. 
To compute expectation values of observables with small sup- 
port we use the relevant reduced density matrix ps, whose 
computation is efficient in the total size N of the system 
S C {1, . . . , N} (see below). Controlled phase gates acting 
exclusively on qubits that are traced out make no contribution. 
We define 



E 



U) ._ ^(i) 



(37) 



where * denotes complex conjugation. The reduced density 
matrix ps is then, by definition of the RAGE states, found to 
be 



= 



k,l 



X |5i,...,5^)(ri,...,r^|(nA^^'''^^(^M))] (38) 

k,l 

The evaluation of the phase gates can be performed to obtain 

1 

o^- V tr \e^^^ E^^^ 1 



^ l-^mi 7 • • • 7 ^rn\s\ ){'^rni •> • • • •)'^', 



kes 



kd 



kd 



For the computation of the reduced density matrix, the ef- 
fect of the phases is a mere modification of the transfer opera- 
tors of the MPS by a phase factor, the phase depending on the 
matrix element in question. Thus, the evaluation of expecta- 
tion values is (as in the case of MPS using the same ansatz for 
observable evaluation) performed using products of transfer 
operators associated with the single sites. The reduced state 
can then be written as 



PS 



E 



tr 



'"mi ! • • • j'^m 



-^|s|- 
\s\'- 



N 



^mi 5 • • • 5 ^m^si 



m\s\ 1 5 



(40) 
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2iAk 



neS 
neS 



(^rfc,l^r^,l)/2. 



, (41) 



(42) 



Grouped in this way, the reduced density operator can indeed 
be evaluated efficiently. In fact, the computational effort for 
the reduced density matrix is merely 0{\S\D^2'^^^^), with an 
initial effort of 0[ND^), as one has to multiply N transfer 
matrices of dimension D'^ x D'^ outside the support of 5, just 
as in the case of MPS. This procedure is inefficient in with 
an exponential scaling effort. However, any Hamiltonian with 
two-body (possibly long-ranged) interactions can be treated 
efficiently term by term. Summing up, the evaluation of the 
expectation value of an operator that is the sum of h terms 
with small support is of the order 0{hND^) 

Please note that the ansatz to compute expectation values 
via the reduced density matrix offered a natural and efficient 
numerical treatment by absorbing the WGS part into the MPS 
description. As this ansatz scales exponentially in the size of 
the support of the observables, another one might be desirable. 



In Sec. IV C we will shift the focus to another picture, where 
the WGS part is not absorbed into the state any more, but into 
intermediate auxiliary observables which will be used for the 
evaluation of the entries of the reduced density matrix. The 
complete step of absorbing the WGS part into the observable 
whose expectation value we want to compute will be made 



in Sec. IV D One can take the point of view that these im- 
plementations are implementing different points of view on 
the modification performed by the graph enhancement. The 
border line is fuzzy, but the complete absorption of the WGS 
into the state - as shown here - and the complete absorption 
into the observables are in a way the extremal points of the 
implementation. 



5. Variational methods 

Apart from procedures for the efficient computation of re- 
duced density matrices, and therefore expectation values, we 
need a variational principle to improve the trial states. We will 



focus on local variational approaches to approximate ground 
states by minimizing the energy, on the approximation of time 
evolution and on the simulation of quantum circuits. We note 
that the search for ground states is well known to be related to 
imaginary-time evolution. 



The MPS part can be updated as shown in Sec. II A 2 



The expression {ij{A,Lp,V)\H\il){A,Lp,V)) is, as for MPS, 

a quadratic form in each of the entries of the matrices ' , 

A\ ' for each site k = 1, . . . , A^. An optimal local update 
can therefore be found by means of solving generalized eigen- 
value problems, with an effort of 0{D^). 

The optimization of the phases and local unitaries is possi- 
ble in several ways. A self-evident method is to treat E = (H) 
as a function over all (polynomially many) parameters simul- 
taneously and optimize it brute force with Nelder-Mead or 
gradient based methods, where one can take advantage of the 
possibility to analytically calculate the gradient. However, 
more systematic approaches are often desirable, as the energy 
possesses many local minima. Thus, after finding an initial 
local minimum with the just mentioned methods, we optimize 
local unitaries and phases one by one using a sweeping tech- 
nique. Note that the phases and local unitaries cancel in the 
normalization term (V^(A, (p^ V)\1\iIj{A^ (p^ V)) and hence do 
not enter the optimization problem. 

The local rotations can be addressed by parameterizing 
single qubit rotations on spin k with a normalized vector 
Xk G as 



(43) 



Again, the local variation of Xk, e.g. for finding a minimum 
of the energy, amounts to a generalized eigenvalue problem in 
Xk for each site k = 1, . . . , N. 

The optimal phase gates between any pair of spins j^k e 
{1, . . . , A/"} can be optimized in another sweeping procedure 
over all phases, while keeping the tensorial part fixed. To do 
so, we first absorb the local unitaries into the Hamiltonian 



N N 



(44) 



k=l 



Then, to optimize the expectation value of H with respect to a 
single phase, say (pa,b^ we reconsider the dependence between 
(fa^b and (H). For each local term H^^f^ we write 



k,l k,l 

= (^MPsI n AZ('='')(-^fc,,) X (AZ(°''')(-^„,fc))F^;=/)AZ(°''')(^„,fc))) X n A^<'''^(^fe,OI^MPs). (45) 

k,l k,l 
k,l^a,b k,l^a,h 



r 

.(c,d) 



It is straightforward to show that for all operators ^ ^ the corresponding operator 

AZ(-'^)(-(^,,5))^,^^/^AZ(-'^)((^,,5)) (46) 
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can be written as 



: ^ /3 COs{(pa,b) +7Sm((^a,6), 



(47) 



with at most 3-local hermitian operators A^B^C (where 5, C 
are zero if {a, b} H {c, d} = 0), and where the state vector 



MPS 



(48) 



k,l 
k,l^a,b 



is independent of cpa^b- The optimization of the phases is thus 
tantamount to the optimization of an expression 



B cos{(pa,b) + r sin((/?o,6), 



(49) 



with efficiently computable real values A, BT. An element 
that is not present for MPS alone: One can make a choice 
whether one adapts an MPS part or the adjacency matrix for 
an identical change in the physical state. In practice, we have 
supplemented this procedure with an gradient-based global 
optimization, making use of the fact that the gradient can be 
explicitly computed. 

We want to mention that, for practical applications, the op- 
timization of the phases takes a lot of time. One reason is 
that many evaluations of expectation values in a RAGE state 
are needed to perform the Nelder-Mead optimization and also 
the individual updates of phase. One more problem is the 
bad convergence behavior of the phase optimization proce- 
dure, as the process usually comes to a halt on intermediate 
optimization levels for many optimization steps. A possible 
alternative to this approach would be a flow-inspired gradient 
method of optimizing over RAGE states f4T\. In many cases, 
however, we will be interested in an approximation of states 
that have RAGE states as a natural description. These are, 
among others, noisy (meaning slightly disturbed) graph states, 
encompassing stabilizer states. In this case, good approxi- 
mate phases for the noisy states can be found analytically. The 
numerical approximation can then be restricted to the tenso- 
rial part of the RAGE states, similar in performance to a bare 
MPS/TTS-approach, see also Sec. |IV C 2| To summarize, an 
update of [^/^(A, (/p, V)) to minimize the energy corresponds to 
a sweeping over local variations, each of which is efficiently 
possible, with an effort of 0{MhND^) for M sweeps. 



B. Time evolution and quantum algorithms 

A natural application of the renormalization with graph en- 
hancement is the simulation of time evolution, where long 
range correlations arise. Instead of the full problem of a gen- 
eral time evolution we would like to consider the more spe- 
cialized but nevertheless important and interesting issue of 
quantum algorithms. These will still exhibit long range cor- 
relations (otherwise they would be simulatable by standard 
methods) but have the advantage that they are already bro- 
ken down into a discrete set of simple quantum operations. 
Indeed, every quantum algorithm may be decomposed into a 
sequence of general single qubit gates and controlled phase 
gates. Such a set of gates seems particularly well suited for 
treatment in the RAGE picture. 



Let us consider the simulation approach in some more de- 
tail before we generalize it to arbitrary quantum algorithms. 
For the consideration of the time evolution we need to make a 
slight restriction to the RAGE states in that we do not consider 
general single qubit rotations but only those that may be ab- 
sorbed in the MPS or WGS part of the state. Thus, we restrict 
attention to state vectors of the form 



(N) 

iN 



X ]^e^^^fc'^^^^'^'^^'^|n,...,ZAr) (50) 

k,l 

where we sum again over indices that are occurring twice. The 
action of a controlled-phase gates will affect only the adja- 
cency matrix, i.e. the values (pk,i- Thus, only the action of the 
single qubit gates will require, perhaps surprisingly, any spe- 
cial attention. If all the phases were zero then the action of 
a single qubit unitary would be trivial as well as they would 
translate into a simple transformation of the type 



^kjk ' 



(51) 



However, the combination of the MPS with the WGS picture 
requires some extra thought. 

Given some initial state vector |?/;(F, (/:?)), we assume that 
a single qubit gate Ui acts on the first qubit. Then we are 
looking for a RAGE state vector + ^^)) which pos- 

sesses the largest overlap with /7i |V^(F, (/:?)), i.e. we would like 
to maximize 



mA,^^/^^)\H^\^{Y,^))\^ 



.(52) 



One may try and ignore the need for an update of the adja- 
cency matrix, i.e. set /S.(^ = 0. One would however expect to 
obtain an approximation of better quality when also updating 
the adjacency matrix. In the following we keep the formula- 
tion as general as possible. To this end we will need to work 
out how to compute inner products between MGS-WGS vec- 
tors with differing adjacency matrices. This is only possible 
under certain constraints, namely restricting the variation to at 
most a single row of the adjacency matrix. 



1. Update of MPS-matrices 

Let us assume for simplicity that the single qubit unitary Ui 
is acting on the first qubit. Then we can disregard all entries 
in the adjacency matrix that do not affect qubit 1. For later 
purposes it will be most helpful to note that 



^0 '"^iN 



N 



k=2 



^1 ' 



.y: 

In 



(AT) 



|1,Z2,...,^ 
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where R{(f) = diag[l, exp(i(/?)] is a single qubit phase gate. 
Thus the action of the controlled phase gates can always be 
transformed into a set of single qubit operations which are 
then easily incorporated into the matrix product picture as 



This comes at the expense of a two-fold overhead in compu- 
tational cost. This overhead increases exponentially with the 
number of qubits the original unitary U is acting upon. Then 
we find 



^0 '"^iN 



|0,Z2, . . . ,^Ar) 



E tr [yI'^yI^\^,^,) . . . r/j^) (^1,^)] |1, . . . , iN) 

(54) 

I 



N 



{i^{A,ip + Aip)\Ui\i^iY,ip)) =(0|C/|0)tr 

+ (0|C/|l)tr 
+ (l|C/|0)tr 
+ (l|C/|l)tr 



k=2 ik 

k=2 ik 

/c=2 ik 
N 



(55) 



Now we proceed in a two step procedure. First one picks an 
MPS -matrix for a single site k and for fixed Acp. This implies 
that the right hand side of the above expression is purely linear 
in the entries of the matrices ^4^^^ belonging to site k, i.e. no 
constant terms appear. Then, we are in a position to translate 
this maximization of the overlap into a generalized eigenvalue 
problem, i.e. 



|(V^(A,(^ + A(^)|i7i|^(y,^))|^ 



{^{A, ^ + A^)mA, ^ + A(^))(V^(F, ^)|V^(r, (^)) 



(56) 



can now be formulated as a purely quadratic form in the nu- 
merator and denominator and thus be solved by a generalized 
eigenvalue problem. The other free variables are the angles 
Aipi^i for / = 1, . . . , which also need to be updated. How 
this is done will be explained in the following. 



2. Update of the adjacency matrix 

One simple, though not very efficient, approach would be 
to randomly pick 2iA(pi^i and vary its value accepting it when 
one found an improvement. Such an approach is however 
slow and prone to local minima. Thus we follow a slightly dif- 
ferent approach that allows us to formulate the problem again 
as a generalized eigenvalue problem. Let us update the entry 
of the adjacency matrix between qubit 1 and k and assume 
that Aif has non-zero entries only in the first row and column. 



k=2 ik 
I 

Now consider the non-unitary operator 

Ui^k = diag[a -\-ib,a — ib, a — ib,a-\- ib] (57) 
= at ^ ibaz ^ cTz. (58) 

Then, with the same unitary Ui sls before we find 

mA,^ + A^)\Ul,U^\i;{Y,^))\^ 

{ij{A,ip + A^)\Ul,Ui,kmAv + ^v)){^{Y,^)\ij{Y,^) 

(59) 

All terms are easy to evaluate and we will only discuss a non- 
trivial term arising in the evaluation of the numerator here. We 
find 

{i,iA,^ + A^)\Ul,ai'^\i>iY,^)) 
= {ip{A, A^)\ul,^(T^ ® R^,^, ® . . . ® R^,J^(Y)) 
= {^{A,A^)\ul,mY,)) (60) 
= a{^{A,Aip)\i>{Y,)) 
+ i6(tA(AA^)|<7«®<TW|^(y,)) 

Thus we obtain an expression that is purely linear in a and b 
leading to a generalized eigenvalue problem which can thus 
solve it efficiently. The evaluation of individual terms pro- 
ceeds in analogy to the decomposition used in Eq. ([53]). 
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3. Further improvements 

It is clear from the above that we have to restrict the update 
to a single row (and the corresponding column) in the adja- 
cency matrix. The computational effort scales exponentially 
with the number of rows that are updated in one step. This 
may still seem like an undue simplification that may restrict 
the success of the method. Let us consider the following im- 
provement. Take a single qubit gate U = e*^ where is a 
Hermitian matrix. So far we have optimized it in one step. 
Instead let us now use that U = (e*^/^)^ and adopt the fol- 
lowing strategy. Apply e*^/^ to the first qubit and then update 
the 1-st column. Now apply e*^/^ to the first qubit and then 
update the 2nd column. In the k-th step apply e*^/^ to the 
first qubit and then update the k-th column. Continue until 
you reach k = N. 



4. Hamiltonian time-evolution 

The above simulation of quantum algorithms happens in 
discrete time applying discrete quantum gates. A very sim- 
ilar approach may be taken for Hamiltonian time evolution 
whereby one uses a Trotter expansion to represent the matrix 
exponential of H 1111601. As is a sum of operators with 
bounded support we are now able to compute inner products 
of the form Eq. ([52]) and thus simulate the time evolution. 
Now expanding the individual terms in the Hamiltonian H 
and employing the above relation to commute terms we can 
simplify the inner products in a manner analogous to the pre- 
vious section and thus obtain simple generalized eigenvalue 
problems that allow us to update efficiently both the matrices 
in the matrix product state and the entries of the adjacency 
matrix. 




FIG. 6. The discrete Fourier transform is implemented by a sequence 
of Hadamard gates and controlled-phase gates with a rotation angle 
for a gate between qubits i and j of 7r/2*~^ . Time increases from 
left to right. 



Still the quantum Fourier transform constitutes a valid set- 
ting in which a RAGE approach is expected to perform very 
favorably compared to an approach based on MPS. The gate 
sequence realizing the discrete Fourier transform is given in 
Fig. |6] Only Hadamard and controlled-phase gates are being 
used. This already suggests that MPS-WGS states are ide- 
ally suited for the simulation of this algorithm. Note that an 
MPS approach alone is expected to deliver not very good re- 
sults: although the angles in the controlled phase gates are in 
parts becoming very small for large the state at intermedi- 
ate times does not satisfy asymptotically an area law in N in 
bisections. This has been looked at numerically for moderate 
values of N. 

Another more feasible and very exciting application of 
RAGE would be the phase estimation problem. In a way, any 
known quantum algorithm of the hidden subgroup variant is 
essentially a phase estimation problem. The task is, given an 
n-qubit unitary /7, and a single eigenvector \v), estimate the 
phase of the eigenvalue 



U\v) = e-^^''^\v). 



(61) 



5. Promising simple quantum circuits 

Apart from full scale quantum algorithms such as Shor's 
factoring algorithm there are some simple applications that 
require only a moderate set of gates. Let us begin with the 
discussion of a particularly simple quantum algorithm, the 
quantum Fourier transform, which highlights the potential of 
the combined MPS-WGS description. Now, it is known that 
several instances of the quantum Fourier transform are classi- 
cally efficiently simulatable: This applies to the semi-classical 
quantum Fourier transform in which the outcome of the circuit 
is measured in the computational basis |62|. Also, the approx- 
imate quantum Fourier transform - in which phase gates with 
small phases are neglected - can be efficiently simulated by 
exploiting a tree tensor network f63l . Ref . f64l considers the 
simulation of the exact quantum Fourier transform, showing 
that if a quantum state can be generated with a small bub- 
ble width circuit, and if the Fourier transform subroutine does 
not increase the so-called bubble width significantly, then the 
Fourier coefficients of the state can be calculated efficiently 
classically (compare also Ref. 1.65 J ). 



In the actual quantum version, we are thought not to know 
U or \v) or e"^^*"^, but one is assumed to have devices that 
perform a controlled- [/, and U'^ , and U'^ , and so on. To do 
so, prepare first 

|V^o) = |0,...,0)|^), (62) 

where the first m qubits are prepared in the |0) state, so m + 
n = N. Then, apply Hadamards to this state vector, 

(i/®'"®l)|Vo) = |0,...,0)|t;). (63) 

How to do this will be explained below. This step is followed 
by the controlled unitaries |0)(0| (g) 1 + |1)(1| (g) [/^\ We 
here should assume that we can conveniently decompose these 
controlled unitaries in a network of matrices that can be mean- 
ingfully decomposed in our setting. This is then followed by 
an inverse DFT. This could be a setting of a full quantum al- 
gorithm where we can estimate local properties finally (or, for 
that matter, the phase). 
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C. RAGE states based on TTS 

In this subsection, we will extend our prior results and 
present and discuss the RAGE states based on TTS as well as 
applicable algorithms. In the case of closed-boundary MPS, 
we exploited the matrix product structure underlying the MPS 
tensor-network in order to make the algorithms efficient. Sim- 
ilar to the original formula for the computation of the entries 
in the reduced density matrix in an MPS, the corresponding 
formula for the RAGE state is based on products of trans- 
fer matrices, with a modification of phases that are derived 
from the WGS part. Analogously, also RAGE states based on 
TTS inherit the algorithms from the TTS, with some modifi- 
cations. This section contains two new aspects of the graph 
enhancement, as compared to the implementation given for 
MPS. First, we will generalize the application of phase gates 
from qubits to higher dimensional qudits. Second, we will (in 
the context of TTS) create intermediate auxiliary observables 
in order to implement the graph enhancement and to compute 
the entries of the reduced density matrix. Hence, the effect 
of the WGS operators is not absorbed by the tensor-network 
state anymore, as in the case of the MPS implementation given 
before. 

Let us first define the generalized phase gate, acting on two 
g'-level spin systems named a and b 



W{(p)= \si,S2){si,S2\e 



(64) 



Si ,S2=0 



Here, (/? is a symmetric matrix cp = (f^, and (/:'[0, 5] = for all 
values of s. For the whole A/^-particle system to be described 
we need one of these matrices for each pair of sites, hence (p 
is a tensor of rank four with elements denoted by (pa,b [si , S2] . 
With it we define the operator 



(65) 



a<b 



With this operator and local rotations Vj G /7(2) we define a 
RAGE state corresponding to a tree tensor state |V^tts) with 
tree r over sites as 



(66) 



These states inherit the properties of the RAGE states based on 
MPS, as the MPS with open boundary conditions are a special 
case of the TTS. These states offer a more variable geometry 
of the graph corresponding to the tensor product state, thus 
leading to RAGE states better suited for certain systems, see 
SecHni 



1. Efficient computation of local properties and correlation 
ffinctions 



corresponding to a TTS. This allows for an efficient compu- 
tation of expectation values of small support, such as local 
Hamiltonians that are sums of polynomially many terms with 
small support, like e.g. in Eq. ( [20| ), and moreover correlators 
of small support. 

We will consider the expression for a support of two sites 
{a, 6} = S with complement S. The expression to be calcu- 
lated is hence 



PS = tr^ [W^IV^TTsXV^TTslW^] . 



(67) 



The cyclicity of the trace causes all phase operators with sup- 
port in S to cancel. Hence we can rewrite the expression above 
using the operator 

ces 

instead, and find that the matrix elements of ps are given by 

Wa^s'b\ps\Sa^Sb) = 
{M [W.,5(kaX<|)^^Hk6)(4l)^'^Wl,J IV^TTS). (69) 

So, each matrix element of the reduced density matrix is given 
by the expectation value of an observable evaluated in a TTS. 
As it is a product of local observables, we can use methods 



known for TTS, see also Sec. II B to compute it efficiently. 

To see this we define now, using a vector ^, the local oper- 
ator 



D-l 



:= J2 m^"^' (70) 
and notice that the operators 1^*^^'^) {^a,b) can be written as 

d-l 

W^^^'\^a,b) = I^X^I ^ ^M-^ ^])- (71) 

s=0 

In this expression, (pa,b[-^s] denotes the 5-th column/row of 
the symmetric matrix (pa,b- Using this expression, we have 

ces^\Sa=o / 

\sb=0 



(72) 



We will now derive an efficiently computable expression 
for the reduced density matrix of the RAGE state \ilj{r, (p^V)) 



and using the relations V {(j)i)V {(j)2) = V{(j)i + ^2) and 
y(^)t = y(_0)^ we arrive at 
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{s'a, Sb\ps\Sa, Sb) 

= (V'TTsI 



ces 



This ex pressio n can be calculated using the known methods 
with an effort of 0{ND^) for each element 



IIB2 



from Sec. 

of ps- Hence, as in the case of MPS, the augmentation with 
WGS did not increase the computational effort when evaluat- 
ing the reduced density matrix. 



phases can still be optimized one-by-one, relying an expres- 
sion analogous to Eq. ( |49| ). The comments on the unsatis- 
factory optimization speed of the phase optimization in the 
context of MPS applies also in this case. 



2. Variational methods 

The optimization of expectations values in RAGE states 
based on TTS is very similar to the procedures in RAGE states 
based on MPS. We optimize the tensorial part and the phases 
independently in a sweeping procedure. Because the relation 

{i;{T,v>,V)\0^^^mr,V>,V))=tv[Ops]. (74) 

holds, and all matrix elements of ps use the same underlying 
tensor product state |V^tts), the computation of an observable 
in a RAGE vector \ijj{r^(p^V)) amounts to the computation of 
an expectation value of a linear combination of observables 
of the kind as given above in Eq. ( [73] ), in the tensor product 
vector IV^TTs)- Provided that the support of the operator O'^^^ 
is small, the number of terms in the linear combination of op- 
erators applied to |V^tts) remains small as well. 

For the tensorial part, similar to the procedure applied to 
bare TTS, we consider the state vector | V^tts) as a linear com- 
bination of other RAGE states, where the combination is con- 
trolled by one of its tensors, say A, see Eq. ( [23] ). The key step 
is then to compute the effective operators H and 1 in the sub- 
space spanned by the linear combinations, dependent on the 
tensor elements Aa,f3,j, and to solve the implied generalized 
eigenvalue problem for the Rayleigh quotient as for bare TTS. 

The optimization of the phases can be realized by follow- 
ing the ideas applied in the case of MPS. In an initial step, 
we interpret the expectation value as a function of the pa- 
rameters of the local unitaries and of the phases, and op- 
timize with Nelder-Mead or gradient based methods. Fol- 
lowing this initial step, we can use local optimizations very 
similar to the ones applied to MPS in a sweeping proce- 
dure. The generalization of the local phase gate AZ*^^'^^ {^a,b) 
(with a single real variable (pa,b) to operators W{(p) (with 
real symmetric matrices (p), acting on d-level systems, im- 
plies a similar relation as in Eq. ( [47] ). While the opera- 
tor is still linear in all sine- and cosine functions, the main 
difference is that more than one phase appears in the dis- 
section of the operator W {(pY H^'^f'^ W {(p) corresponding 

to AZ(«'^)(-(^,,5)^,^'/^A^^"'^H^a,6) in Eq. All the 



D. Further extensions 

In this section we will focus on possible extensions of the 
RAGE method. Consider a class of state vectors of the form 

W=U\^), (75) 

where \ (p) stands for a quantum state vector described by some 
tensor-network for which an (approximate) algorithm to eval- 
uate tensor products of local observables Oi (g) O2 ... Oat ex- 
ists. For instance, MPS, TTS and PEPS fall within this class. 
In addition, U denotes a circuit of quantum gates to be speci- 
fied below. In order to find the optimal representative within 
such a variational class of states that minimizes the energy, 
mm\^^ {iIj\H\iIj) / , in many relevant systems it suffices 
to compute expectation values of observables with a small 
support. In particular, for pairwise interaction Hamiltonians 
the support is limited to two, as the Hamiltonian can be writ- 
ten as a sum of (at most polynomially many) terms of the form 
qMqU^) acting only on particles a and /3. In fact, any such 
observable can be written in the Pauli basis, so it suffices to re- 
strict oneself to Pauli operators cr-"Vj^^ as 0^"^02^^ can be 
represented by a sum of at most 16 Pauli-terms. Similar con- 
siderations hold for any /c-body interaction Hamiltonian with 
bounded k. 

Consider now (?/^|cr-"Vj^^ |?/^) with |?/^) being of the form 
Eq. ( [75] ). We let U act on the observable and obtain 
{(p\{U^ a^^"^ aj^'^U)\(p) . It is immediately clear that as long as 
U transforms the two Pauli operators to either a tensor product 
of Pauli operators or to a sum of polynomially many Pauli op- 
erators, this quantity can still be evaluated efficiently. Each of 
the terms only requires the evaluation of a tensor product of lo- 
cal observables for a tensor-network state, which is efficiently 
possible by assumption. Such a situation occurs for example 
for any operator U corresponding to a Clifford circuit, which 
maps by definition tensor products of Pauli operators to tensor 
product of Pauli operators under conjugation. 

Notice that a Clifford circuit can thereby produce a large 
amount of entanglement and is not restricted in its depth. 
Moreover, a Clifford circuit is able to enlarge the support of 
an operator arbitrarily; hence an evaluation of an observable 
under such a modification is in general not efficient using the 
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reduced density matrix. Algorithms allowing for the evalu- 
ation of product observables with arbitrary support, as given 
for TTS before, are still appHcable. 

Similarly, any quantum circuit of depth n consisting of 
nearest-neighbor gates transforms the initial observable with 
support two to an observable that acts (at most) on 4n + 2 par- 
ticles and hence can be represented by a sum of at most 4^^+^ 
Pauli terms. As long as the depth n of the circuit is bounded or 
scales logarithmically in the number of particles N, one can 
efficiently evaluate the resulting observable as a sum of only 
polynomially many Pauli-terms. Hence all states of the form 
Eq. (75) where U is 3. log-depth quantum circuit and \(p) is 



e.g. a MPS, TTS or PEPS can be used as variational family. 

Notice that also the efficient observable evaluation for the 
RAGE class based on MPS discussed in the previous sec- 
tion can be understood in this terms, although we have given 
a more efficient implementation tailored for operators with 
small support there. In this case. 



(7,5) 
PG 



(76) 



7,(5 



is a product of commuting phase gates. Hence all phase gates 
that do not act on particles a or /3 cancel in cjf^U. 
The action of the remaining gates acting on particles a, P can 
however be described by a matrix product operator (or other 
tensor-network operator if required) of small dimension. This 
can be easily seen by considering a bi-partition of the system 
into particles a, /3 vs. rest. All gates that do not cancel act 
between these two groups (or between a and j3). The amount 
of entanglement between these two groups is bounded by the 
physical dimension of the system a, /3, and hence also 
the amount of entanglement of any operator acting between 
these two subsystems is bounded by d^. For phase gates one 
finds that the resulting operator describing cr\^^ cr^^^U can 
be written as a matrix product operator of dimension I) = 4. 
Applying such an operator to a matrix product state of dimen- 
sion D' yields another matrix product state of dimension at 
most 4:D' . The evaluation of the observable crf^V,-^^ hence 
reduces to calculating the overlap between two matrix prod- 
uct states of (slightly) increased dimension, which still can be 
done efficiently. 

So far, RAGE states have been used to implement an en- 
hancement of tensor network states due to the incorporation of 
features of weighted graph states. Now we would like to con- 
sider the entire class of Clifford circuits. Thereby, we will per- 
form the whole step of shifting the effect of the enhancement 
away from the picture of the modification of the underlying 
tensor-network state to the new picture where the observables 
themselves are modified by the enhancement. Please note that 
extensions into the other direction, namely the extension to 
more general tensor-network states, are also possible, as will 
be demonstrated at the example of PEPS states in Appendix|B] 

As we have seen in the previous sections, several families 
of tensor-network states can be supplemented with circuits of 
commuting unitary operations in such a way that they form a 
good variational set of states. In particular, relevant quantities 
such as expectation values of local observables (e.g. energy of 



/c-body interaction Hamiltonians) can be efficiently computed, 
and efficient optimization methods are applicable. In this sec- 
tion we show that one can indeed replace the circuits of com- 
muting phase gates by other types of quantum circuits such as, 
e.g. Clifford circuits while maintaining the favorable features 
regarding evaluation and optimization, thereby significantly 
extending the variational class of states, their respective fea- 
tures and their possible range of applicability. 



V. APPLICATIONS OF RAGE STATES 

In this section we want to consider applications of RAGE 
states based on different tensor product states as well as bare 
tensor product states in comparison. There is a wide range of 
possible applications for variational quantum states. Among 
them is the numerical exploration of quantum mechanical 
condensed matter systems. As theoretical considerations and 
real world experience suggest, ground states of interacting 
quantum systems typically show emergent phenomena, often 
due to a high degree of correlations of the local constituents. 
It is hence challenging to provide variational classes that are 
able to grasp these correlations and entanglement features. 

To investigate the ability of the RAGE states to approxi- 
mate ground states, we treat the Ising and Heisenberg model in 
two dimensions. When describing the ground states of these 
Hamiltonians, the MPS and TTS usually perform badly in the 
regime where the dimensions of the employed matrices allow 
for an efficient treatment. This behavior is expected to be im- 
proved by introducing the WGS enhancement to the MPS and 
TTS, allowing essentially to follow an area-law for the entan- 
glement. In the performed simulations, the adjacency matrix 
is allowed to connect any constituents in the lattice with indi- 
vidual phases. This is the most general enhancement that we 
can implement with our RAGE ansatz, however, it is possible 
to introduce more symmetries and restrictions to speed up the 
computation. 



A. The 2D Ising model 

A well studied toy-model is the 2D Ising model with trans- 
verse magnetic field 



(a, 6) a 



(77) 



The aim of our numerical treatment is to find an approxima- 
tion of the ground state by optimizing over the energy of trial 
states in a sweeping procedure. Fig. [7] shows the achieved 
ground state energy for the MPS alone and the RAGE states 
based on MPS, where in both cases the MPS follows a chain- 
like path through the 2D setting. What can be seen is that 
for a very low parameter count, the RAGE states perform bet- 
ter than the MPS. However, this advantage becomes negligi- 
ble for larger numbers of parameters, although qualitatively 
the RAGE states always perform better. In the regime with a 
small number of parameters, e.g. around 300 — 1000, the ac- 
tual quality of the approximation is not very good, as the states 
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FIG. 7. (Color online) 2D Ising model with B = 2ona4x4 
periodic lattice. We compare the achieved accuracy within the RAGE 
approach and for MPS. The graph depicts the energy for different 
total numbers of complex parameters in comparison with the exact 
ground state as well as the first excited state. In Figs. [7] [8] [9] the 
MPS is realized numerically as Siflat tensor tree state, i.e. it is non- 
periodic. This implies that tensors close to the leaves of the tree 
change the local bases only and are hence redundant. 
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FIG. 8. (Color online) 2D Ising model on a 4 x 4 periodic lattice. 
We compare the achieved accuracy using RAGE and MPS (D = 4) 
with exact results. The total number of independent parameters is 
384 for MPS and 476 for the RAGE state. Two-point correlations as 
function of B are shown. The error bars stem from differences in the 
local two-point correlations due to the explicit breach of translational 
symmetry in the necessarily linear topology of the MPS ansatz. 



approximating the ground state have an energy comparable to 
the first excited state. 

The situation is very different when we look at the corre- 
lations. As Fig. [8] shows, the RAGE states show significantly 
better two-point correlations, already for a very small number 
of parameters, delivering virtually indistinguishable numeri- 
cal values compared to the exact results. The values shown 
in the graph are mean values over all sites (and their neigh- 
bors) in the system. The high variance of the values in the 



MPS case stems from the different values obtained at different 
sites, as the MPS description necessarily breaks the 2D sym- 
metry of the model. The RAGE description does not show a 
any variance (within numeric accuracy), the correlations be- 
ing translationally and rotationally invariant, as is the Hamil- 
tonian. This shows that the RAGE states can adapt to the 2D 
setting much better and do not break the symmetry as the MPS 
alone. 

It is interesting to see that the correlations are described 
well, even though the energy approximation is comparatively 
bad, although we aimed for a good description in terms of the 
energy. This seems to indicate that even in a situation where 
some features of the system cannot be approximated well by 
the RAGE states, geometry-dependent symmetries will be re- 
flected. In numerics, the situation is often the opposite: Al- 
though a parameter that has been aimed at is well-described, 
other features of the system are completely lost in the descrip- 
tion. The RAGE states seem to be favorable in a situation 
where geometric symmetries play a role. 

B. The 2D Heisenberg model 

Another toy model that we use is the 2D Heisenberg model, 
described by 

H=Y^ai^^ai^^^ai^^ai'^^4^^ai'\ (78) 

(a,6) 

where (a, b) denotes nearest neighbors. It is known to be nu- 
merically more challenging than the 2D Ising model. We ap- 
proximate the ground state of the system using MPS and TTS, 
as well as RAGE states based on MPS and TTS. We observe 
that the achieved energy is always larger than even the energy 
of the first excited state. However, as expected, the RAGE 
states perform better than the MPS and TTS without WGS en- 
hancement, the TTS having a slight advantage in the regime 
with a low parameter count. 

Even though the RAGE states allow for new features like 
long-range correlations and a violation of an area law, they 
break the local SU (2) gauge invariance. It is clear from the 
simulations that the limitation of the underlying ID structure 
of the MPS and TTS cannot always be fully overcome by the 
graph enhancement. 

C. Simulation of a disturbed toric code state 

The RAGE method is particularly well suited for certain in- 
teresting parent Hamiltonians, as the WGS include all graph 
and hence stabilizer states. Any graph state vector \G) is the 
common eigenvector with eigenvalue 1 to a set of operators 
{Ka}, i.e. Ka\G) = |G), the state vector \G) is automati- 
cally the ground state of the Hamiltonian Hq — ^a- 
Imperfections, e.g. stemming from imprecise preparatory pro- 
cedures, can be simulated by a slight deviation from the given 
form, e.g. with local magnetic fields 

ff^:=-^X, + ^/ii<T«. (79) 

a i 
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FIG. 9. (Color online) 2D Heisenberg model on a 6 x 6 periodic 
lattice. We compare the achieved accuracy of bare tensor-network 
states with RAGE states. Also, values of the ground state energy 
and the first excited energy from quantum Monte Carlo simulations 
are shown | 61 1. The number of computational steps for the evalua- 
tion of expectiation values is, as shown in the main text, 0{ND^) 
and 0{ND^) for MPS and TTS respectively; the combination of 
these states with WGS amounts to a change by a constant factor. The 
optimization, in turn, relies on a constant number of evaluations of 
expectation values per single optimization step. The number of such 
steps needed for satisfactory convergence is much higher for RAGE 
states than bare MPS and TTS as the state space is different. 



The undisturbed forms of these states, i.e. the ground states 
of the undisturbed Hamiltonians Hq, have phases that can be 
found analytically, using an algorithm relying essentially on 
Gaussian elimination. If the amount of noise is small, these 
phases are still reasonably close to the phases of the noisy 
states, i.e. the ground states of the disturbed Hamiltonians 
Hq. Hence, treating these systems, the values of the phases of 
the noisy states will be fixed to the analytically found values 
of the corresponding undisturbed state, and the approxima- 
tion will be performed over the tensors only. This is useful 
insofar as the WGS operators contain the essential entangle- 
ment characteristics also of the slightly disturbed states, which 
leaves only the (disturbance of the) entanglement created by 
the noise terms to be reproduced by the tensor product state. 
In many noise models it is sufficient to use MPS or TTS with 
small index dimensions only, as the noise is typically spatially 
uncorrected. A variational method based only on WGS does 
not offer this kind of ansatz, as all the entanglement has to be 
described by the WGS part. 

The example that we use is the perturbed Kitaev model, 
whose ground state is, in the unperturbed case, the toric code 
state 13911 . This state is actually a suhspace of the Hilbert 
space which is the common eigenstate with eigenvalue 1 of 
a set of operators to be defined in the following. Starting from 
a rectangular lattice, we identify all edges between nearest- 
neighbor vertices in the lattice with quantum mechanical 
spins. A generator the operator set can now be defined by the 
operators {(Jx^ax^ax^ax)^^''''^^ and {az^crz^az^cr^)^'''''^^^ 
where the loops are the smallest possible loops (constituting 
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FIG. 10. (Color online) Kitaev model on a periodic 2D lattice with 
N — 12 with magnetic field B in x-direction. We compare the 
achieved accuracy for the ground state using MPS (D = 20 and 
D — 10) and RAGE states with fixed phases and underlying MPS 
of D = 1, 2, 3, where D = 1 corresponds to WGS. For B = 0, the 
ground state is exactly described by a WGS. For comparison, the first 
excited state is plotted (El). For larger N, similar results are found, 
although the exact treatment was no longer possible. 



the set L) in the lattice and the crosses the smallest possible 
edge configurations with a cross shape (constituting the set C) 
except for one, otherwise the generating set would not be in- 
dependent. The unperturbed Hamiltonian whose ground state 
is given by all states in the stabilized subspace can hence be 
chosen as 



^Toriccode = " ^^{^x ^ CF x ^ x ^ x] 



- ^{(Tz ^(Jz^CTz® ^^)^'^. (80) 

As the operators form an (incomplete, because a subspace is 
stabilized) stabilizer, we are able to derive the local-unitary 
equivalent graph form of the Hamiltonian to obtain 



Toric code 



(81) 



We have simulated the ground state of this model on a pe- 
riodic 2D lattice with 12 sites where the additional perturba- 
tion was described by uniform local magnetic fields of varying 
strength resulting in a Hamiltonian 



(82) 



describing the system under consideration. For numerical re- 
sults, see Fig. fTOl We observe that even for fixed phases of 



the WGS - adjusted to match the toric code state at zero field 
- and an underlying MPS with the small dimension D = 3, 
we obtain a significantly improved accuracy as compared to 
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WGS and MPS with a much higher number of parameters, 
i.e. using a matrix dimension D = 20. It is interesting to see 
that there is a local minimum for which the RAGE description 
is particularly good. 

As the strength of the local magnetic field increases, the 
ground state of the Hamiltonian loses its similarity with the 
unperturbed ground state and eventually approaches a product 
state (although the field strength is not big enough to get re- 
ally close to a product state.) Accordingly we observe that for 
small field strengths the RAGE states provide a good descrip- 
tion of the ground state and the MPS cannot cope, even for 
high matrix dimensions. While the energy of the RAGE state 
with underlying matrix dimension d = 3 is always well be- 
low the energy of the first excited state, the RAGE states with 
matrix dimension d = 1,2 show this behavior only above a 
certain threshold. For strong local fields the MPS start to per- 
form better and eventually outperform the RAGE state with 
d = 1. This is due to the fact that the tensor-network part 
of the RAGE state has now to compensate for the wrong static 
phases (derived with assumption that local fields are absent) in 
the WGS description, which become worse estimates for the 
true phases as the influence of the local fields grows. How- 
ever, the RAGE states with d = 2, 3 are always better than the 
bare MPS, even though the (now) wrong WGS phases must 
be compensated. We conclude that the RAGE states are bet- 
ter for the description of disturbed graph states than the bare 
WGS, which correspond to the case D = 1. 

This nurtures some hope that the RAGE description is ac- 
tually powerful enough to cope with aversive situations, and 
that only the optimization algorithm that we employed for the 
ground state approximation could not find the optimal solu- 
tions. The improvement of these algorithms is therefore an 
important point for future research. 



D. Quantum circuits 

We have tested the RAGE states in a simulation of a random 

and compared the achievable 



quantum circuit (see Fig. 11 



accuracy with MPS. This circuit has to be applied to an initial 
state that has an efficient classical description in the first place. 
We apply sequences of (i) random single qubit phase gates and 
(ii) random controlled phase gates to an initial random MPS 
state. In each case, the phase is drawn uniformly from [0, 27r), 
as well as the support of the gates is drawn from the uniform 
measure. For the random MPS as an initial state, random 2 x 
2 matrices have been employed, each of the form A -\- iB, 
with the entries of A and B being independently identically 
distributed on [—1,1]. The evolution is then being kept track 
of both with a RAGE and an MPS ansatz: In the RAGE ansatz 
by updating the phases in case of the random phase gates and 
adapting the MPS part in case of local gates, in the MPS case 
by employing a sweep in order to find the best MPS ansatz 
compatible with the new state obtained by the application of 
a gate just as being used in DMRG. The plot is obtained from 
drawing 500 realizations of the resulting stochastic process. 
Again, we obtain a significant improvement due to the WGS. 
Here, the advantage of the RAGE ansatz is most transparent. 
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FIG. 1 1 . (Color online) Comparison of MPS and RAGE with D = 2 
for the simulation of a random quantum circuit on = 14 qubits. 
An application of a random local phase gate followed by a random 
controlled-phase gate with random uniform phase in [0, 27r) consti- 
tutes one block. For given k we apply this block k times to a ran- 
domly chosen initial MPS state. 500 such runs are determined, and 
in each the fidelity with the exact state is computed. The average 
over 500 realizations is then plotted. 



as the interactions are not local, and it is exactly the long- 
range nature of the support of the random phase gates that the 
RAGE ansatz can capture well. 

Note that similar random circuits - ones where the phase 
gates are replaced by random unitaries drawn from the Haar 
measure - give rise to an approximate unitary 3-design. These 
can be used to show that for almost any sufficiently long quan- 
tum circuit one can construct a black box problem that is 
solved by the circuit in a constant number of queries, while re- 
quiring exponentially many classical queries, even under post- 
selection |66|. That is to say, a random circuit quite similar to 
the above one certifies, when setting up a black box problem, 
the superiority of a quantum computer compared to a classical 
one. 

Starting from here, further delineating the boundary be- 
tween efficiently classically simulatable circuits and those ex- 
hibiting a speedup offered by quantum computation, consti- 
tutes an interesting perspective. This topic is also exciting 
since our results show that the scaling of the entanglement 
entropy alone is not always significant for the classical sim- 
ulatability of a quantum state. This observation has already 
been made in the context of quantum cellular automata. They 
give rise to tensor networks that are efficiently contractible, 
yet still slightly violate an area law for the entanglement en- 
tropy 1201 . In the context of random circuits, though, states 
are encountered that exhibit a much larger degree of entangle- 
ment. 
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E. Conclusions 

1. Comparing MPS and TTS 

We have compared MPS and TTS to determine how well 
they are suited for the description of states relevant in con- 
densed matter physics and to find out where their respective 
strengths are. We employed both analytical and numerical 
methods. Analytically, we have given an example where TTS 
can offer an advantage for the approximation of states. In the 
given example, we required a certain entanglement structure 
to be reflected in the description, and found out that the num- 
ber of parameters scales more favorably for the TTS than the 
MPS in this case. This is a motivation, at least under cer- 
tain circumstances, to include the more general TTS into our 
RAGE description. 

In addition, we have given examples of variational numeri- 
cal approaches for the description of ground states using TTS 
and MPS. The used examples are models with interactions 
which are likely to give rise to entanglement properties that 
are suspected to be difficult to describe by MPS (long range 
interactions, broken symmetries.) We found ambivalent re- 
sults. 

An interesting observation is that although the TTS descrip- 
tion does offer advantages, the cases where it is really useful 
are not easy to identify. The straightforward argument that a 
possible improvement seems likely in cases where interaction 
symmetries are broken (being reflected by the broken sym- 
metries of the tree description itself) or where interactions are 
long-range is too simple. On the other hand, the analytic argu- 
ments that can be made lead to a whole class of very suitable 
states. 



2. Applications of RAGE states 

We have applied the RAGE states for the simulation of the 
Ising and the Heisenberg model on two-dimensional lattices. 



as well as the toric code state (disturbed by local magnetic 
fields.) The applications of RAGE states leave a two-fold im- 
pression. On the one hand, we have good results describing 
the disturbed versions of graph states like the toric code state, 
using only a very modest amount of parameters. This reflects 
our intuition that a graph state (having a description in terms 
of few parameters) under the influence of a local noise model 
(again: few parameters in the characterization) should be a 
structure which can be grasped with small amount of data. 
As we see in the simulations, the disturbance can be well de- 
scribed by the tensor product state combined with the (undis- 
turbed) weighted graph-description. 

However, on the other hand, the RAGE description has 
its limits. Typical condensed matter systems like the ground 
state of the 2D Heisenberg model are apparently still to far 
away from the RAGE states to be approximated well with 
this set. Apparently, even simple interactions that appear in 
physical models of condensed matter systems produce very 
rich ground states, essentially beyond a characterization with 
weighted phase gates and DMRG methods, even if combined. 
It is the hope that the present work can contribute to the quest 
for identifying the set of quantum states that can be efficiently 
classically simulated and that in a sense still captures the rel- 
evant degrees of freedom of a problem. 
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Appendix A: The canonical form 



When optimizing a tensor as in Sec. II B 3 it is useful to 
work in a canonical form of the TTS, where in Eq. ( [23] ) the 
set of states {|(^^)}, {|(/:?|)}, {|(/:)^)} are orthonormal each. In 

this canonical form, 1 from Eq. p4| ) is a unit matrix. This 
spares the calculation of this matrix and moreover simplifies 
the computation of the energy E and the corresponding tensor 
A, compare also Ref. |52|. 

Another not immediately obvious benefit of the canonical 
form is to make the optimization algorithm numerically more 
stable. The (ordered) spectrum of Schmidt coefficients in the 
bi-partitions of ground states, which we are searching for in 
the optimization, shows usually quickly diminishing magni- 
tudes. If the canonical form is not used, this property carries 
over to the quantum mechanical amplitudes used in the defini- 
tion of the matrix 1. Hence, the closer the sweeping procedure 
gets to the actual ground state, the more singular the matrix 1 
becomes. This makes the algorithms solving the generalized 
eigenvalue problem (underlying the minimization problem in 
TTS unstable. 

To define a useful canonical form of a TTS consider the fol- 
lowing. Fixating a tensor A in the graph implies a half-order 
of tensors, defined by the distance of tensors from the tensor 
A in the tree. Each path in the tree defines a completely or- 
dered set of tensors, which we call a chain of tensors. There 
is only one leaf in each chain, and it is the last element (the 
bottom element) of such a chain. Hence there are as many 
chains as we leaves in the tree. To transform the TTS into its 
canonical form, we will perform an iterative orthonormaliza- 
tion procedure to each chain. We start from the bottom, which 
is a leave node and go to the top, which is a tensor connected 
to the tensor A to be optimized. 

As the leaves of the tree correspond to single particle spin 
systems, we can easily find an orthonormal basis for this sys- 
tem. Beginning with the leaves we will from now on assume 
all subsystems in a chain are already orthonormal. Consider 



the situation in Fig. 12 and let tensor C be the lower one in 
the chain, i.e. the position of tensor C in the chain is n and the 
position of tensor B in the chain is n + 1. With the two lower- 
level subsystems {|(/?^(n — 1))} and {\ipi^{n — 1))} stem- 
ming from the two chains spawned from tensor C when going 
away from tensor A, we formulate the state belonging to the 
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FIG. 12. (Color online) A bi-partition of a TTS along an edge, lead- 
ing to two simply connected sub states. The Schmidt decomposition 
can be inferred directly from the tensors adjacent to the edge. 



sub state linked to the tree via edge a 

/3i,/32 

The orthonormality condition for the vectors {|^ck(^))} reads 
^a'^a ={^l>{n)\Lpl{n)) 

= ^a',/3;,/3^^a,/3i,/32 
/3;,/3i,/3i,/32 

X ((^1, (n - l)\^l^{n - l)){^\{n - l)\^\{n - 1)) 

= X] ^a',/3i,/32^a,/3i,/32- 

(A2) 



last R matrix of any chain, which cannot be absorbed any- 
more, can be thrown away, as it would be absorbed into the 
tensor to be found in the eigenvalue procedure anyway. 

This procedure is applicable as is to open-boundary MPS, 
as they are a subset of the TTS. Unfortunately, closed- 
boundary MPS suffer from similar numerical instabilities 
when approaching the ground state. In this case, we apply the 
procedure given above to a version of the closed-boundary 
MPS which is made open-boundary by cutting an arbitrary 
edge. Beware, in this case the matrix 1 is not a unit matrix, so 
we still have to solve a generalized eigenvalue problem, but at 
least i is not close to singular anymore, providing numerical 
stability. 



Appendix B: Projected entangled pair states 

We want to point the readers' attention to the fact that the 
basic procedure, underlying all evaluations of observables and 
also the variational methods in tensor-network states, is the 
summation over all possible values of the indices of the ten- 
sors in the description of the tensor-network state. The pre- 



/3l,/32 



With index reordering /3i,/32 = {Pi^h)^ these tensors are 
matrices and we can apply a QR-decomposition 



a(/3i,/32) 



X]Q(/3i,/32)a^a,a 



(A3) 



with an orthonormal matrix Q and an upper triangular matrix 
R. As the state vectors themselves are correspond to 

subsystems of a state higher in the chain, we can absorb the 
matrix R into the tensor of the higher level, in this case 

|(pi,(n + l)) = 5]l)^„a,^J^J.(n))K(n)) (A4) 

a, 71 

and we can absorb R into D 



^72,Q!,7i ^ ^72, a, 71 ~ Ra,a'D^^^ 



Q!',7l 



(A5) 



while at the same time replacing B hy Q (with reshaped in- 
dices.) This makes Eq. ( |A2| ) true. As a QR-decomposition 
is an efficient algorithm (and here applied to matrices with di- 
mension DxD'^), each step is efficient. All in all, there are N 
chains to consider and maximally N tensors in a chain, mak- 
ing the treatment of the whole tree efficient. This orthonor- 
malization procedure is consistent between different chains, 
as there are different elements in different chains, but no two 
chains contain the same two tensors in different order. The 



sented algorithms of Sees. II A 2 and II B 2 circumvent the 
complexity of the contraction problem exploiting additional 
properties of the respective tensor-networks. If a generic net- 
work has such exploitable favorable properties is in many 
cases unknown. 

In the case of MPS and TTS, in particular, we make use 
of the essentially one-dimensional structure of the graphs un- 
derlying the network, e.g. by using redundancy in the recur- 
sive procedure of a tree-contraction, or the possibility to write 
down a sum of many matrix products in shorter form using, es- 
sentially, the distributive law. However, even the possibility to 
efficiently contract a network alone is not a sufficient criterion 
for the possibility to efficiently approximate ground states. 
Even if each step in an updating procedure can be performed 
efficiently, the convergence of the procedure over many steps 
can be very slow. It is e.g. possible to encode computationally 
hard problem as a ground state approximation problem in an 
MPS, as has been shown in Ref. |59|. 

Another type of state not corresponding to a linear structure 
is the projected entangled pair state (PEPS) CSl. The PEPS 
are tensor-network states, similar to the MPS and TTS, but 
correspond to graphs with loops. This generalization has ma- 
jor consequences, improving the entanglement properties on 
the one hand, but making it necessary to find new algorithms 
for computing expectation values and updating the description 
on the other. There are no known efficient algorithms for the 
exact contraction of such a network. This might be due not to 
a lack of ideas but an inherent computational hardness of the 
problem 1671 . Approximate contractions are still possible, as 
will be shown. 



1. Definition and properties 

It is not necessary to restrict the number of unphysical in- 
dices per tensor to two, like in the example of MPS, but in 
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FIG. 13. (Color online) The graph corresponding to a two- 
dimensional PEPS shows a higher connectivity than the graph cor- 
responding to an MPS. 



principle any number is possible. Consider, for example, the 
following network structure 



^Si,...,Sg 



E.(1)S1 .(2)S2 4(3)S3 .(4)S4 

^ai,/3i^ai,a2,/32^a2,/33^/3i,a3,/34 

Greek indices 



l(5)s5 



^ At^'l A^I^Z A['}r „, ^(fil . (B 1) 



a3,/52,Q!4,/35 f^3,Ot4,(3e /34,Q!5 Q!5,/35,Q!6 Q!6,/36* 

Here, the tensor with components As^^,..^s9, connecting to the 
physical indices, and used to define the PEPS 

IV^PEPs) = ^ . . . ,59) (B2) 



is obtained by summing over a network of nine tensors, which 
are connected to the nearest neighbor in a two-dimensional 
grid. The network corresponds to the graph depicted in 



Fig. 13 



To understand the entanglement properties of PEPS, it is 
useful to give the MPS description another interpretation, 
which can be found in the construction and analysis of the 
famous AKLT-model |l43l. In this context, a subsystem of 
two contiguous sites 1 5^,5^+1), as taken from e.g. Eqs. ^ 
and (|4]), and corresponding to two tensors (or matrices) 



j(n)s 



i(n+l)s„ 



(B3) 



is interpreted as a projection of a maximally entangled 
pair of auxiliary sites, Xl^=o^ 1/^)1/^)' using the tensors 
^(n)s^ , yl(n+i)sn+i as projectors. 

The upper bound on the bi-partite entanglement of an MPS, 
as implied by cutting edge f3, is directly related to the number 
of maximally entangled pairs which are cut in the bi-partition. 
This picture very naturally carries over to the PEPS construc- 
tion. Depending on the connectivity of sites, PEPS can fulfill 
area- and even volume laws. 



2. Evaluation of observables and variational methods 

In this subsection we will briefly outline how to evaluate an 
observable in a PEPS and how to apply variational methods to 




FIG. 14. (Color online) Schematic representation of a PEPS contrac- 
tion. The top layer corresponds to the ket-PEPS and the lower layer 
corresponds to the bra-PEPS. The dashed ellipse denotes the tensor 
structure which is contracted first, resulting in a single-layered rect- 
angular tensor grid. The resulting rectangular grid is then contracted 
using MPS methods. 



a PEPS, which can be based on evaluations of expectation val- 
ues and overlaps as well. More precisely, similar to the case 
of TTS and MPS, the computation of an expectation value in 
a PEPS amounts to a contraction, i.e. a summation over the 
indices, of the tensor-network, see also Sec. |B] As this is a 
computationally hard problem in principle, we want to make 
use of an inherent structure in the description of the PEPS in 
order to simplify the contraction problem, similar to the case 
of MPS and TTS. 

The structure to be exploited is the equivalence of a) con- 
tracting a d-dimensional PEPS to b) the transfer of a — 1)- 
dimensional quantum system. As an example, consider the 
computation of the norm of a two-dimensional rectangular 
PEPS, corresponding to a graph as given in Fig. [13] The treat- 
ment of the transfer problem is in this case simplified by the 
fact that the one-dimensional quantum system is given by an 
MPS and the transfer operators are given by matrix product 
operators (MPO) applied to the MPS. This problem is can 
be treated effectively using approximate contraction methods. 
The algorithm we refer to in the following was introduced in 
Ref. IM- 

The expression to be computed, serving as an example is 
the square of the norm (V^pepsIV^peps), and corresponds to 
Fig. [14] The top layer, as depicted in the figure, corresponds 
to the ket-PEPS and the lower layer corresponds to the bra- 
PEPS. To reduce the tensor grid to the transport problem in a 
one-dimensional quantum system, we first contract the physi- 
cal sites, i.e. we perform the contraction {s[\si) for all values 
of 5, 5' and i, leading to new tensors, e.g. 



B 



55,55 

(5) ^V^^(5)55 ^*(5)S5 

(B4) 



Here, 5 is a tensor of rank 4 with new effective indices 
(as, 0^3), etc. This procedure results in a rectangular grid. 
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The computation of product observables is similar, the ex- 
pressions {s[\si) being replaced by (s-IO*^*^ with a local 
observable (9*^*^ acting on site i. For the updates in a varia- 
tional method, a replacement of tensors with tensors of type 
D in Eq. ([TO]) can be performed in a straightforward manner, 
leading to quadratic forms analogously to the case of MPS. 

We treat the grid of 5-tensors as follows. The first (e.g. hor- 
izontal) line of tensors at the boundary can be interpreted as 
an MPS, where the lower indices are considered open. The 
second line can be viewed as an MPO acting on the first MPS. 
The resulting state (after contracting two lines) can again be 
described by an MPS, but of increased dimension. The aim 
is now to find (e.g. via a variational method) the optimal ap- 
proximation of the resulting state by an MPS of fixed (low) 
dimension. This is e.g. done by optimizing the individual ten- 
sors via solving a generalized eigenvalue problem. The MPS 
found this way is now processed further, i.e. the MPO corre- 
sponding to the third line of tensors is applied, and one again 
aims at obtaining a proper approximation of the resulting state 
by an MPS of fixed dimension. The process is repeated until 
the second to last line of tensors is reached. The final step 
corresponds to calculating the overlap of the MPS resulting 
from above procedure (after processing all but the final line), 
and the MPS corresponding to the final line. Summarizing: 

(i) Start with i = 1 and set (Mi| := (Mi|. (ii) Apply the 
MPO Mi+i to the intermediate MPS (Mi,...,i|. Both having 
a small bond-dimension, we obtain an MPS of large bond- 
dimension, (Mi^...^^+i|. (iii) Reduce the bond-dimension of 
(Mi,...,i+i| to obtain another intermediate MPS (Mi,...,i+i|, 
representing (Mi ... | as good as possible with this smaller 
bond-dimension, (iv) Increase i by one and continue with step 

(ii) . For details of the method, we refer the reader to Ref. |44|. 
The precision of this kind of contraction can moreover be im- 
proved by an error-correction scheme, introduced in Ref. B31 . 

The accuracy of the approximation depends on the com- 
pressibility of the intermediate MPS with large dimension into 
a version with smaller dimension. This compressibility is 
hence related to the amount of entanglement in the interme- 
diate MPS which is created by the applied MPO. A PEPS that 
is close to a product state clearly induces MPS and MPO that 
produce intermediate MPS with comparatively little entangle- 
ment., and hence can be treated well by the given method. 



Appendix C: RAGE states based on PEPS 

As shown in Sec.|B] in a PEPS any (physical) site of a cho- 
sen subset of an arbitrary subsystem can share one (or more) 
maximally entangled pairs of auxiliary sites with any (phys- 
ical) site outside the subsystem. Hence the upper bound on 
the block-wise entanglement in the state can not only be in- 
creased by increasing the index dimension D of the tensors 
(corresponding to the dimensionality of the auxiliary system), 
but also by raising the number of pairs shared between the 
subsystem and the remainder of the system. This is the main 
difference to the MPS and TTS described above. Another im- 
portant observation is that even if we restrict the sharing of 
auxiliary pairs to nearest neighbors, a volume law can be sat- 



isfied. This makes the PEPS description very powerful. We 
will now consider the combination of PEPS and WGS. Al- 
though PEPS can fulfill a volume law in any dimension, it is 
in some cases advantageous to put some information from the 
PEPS description into a WGS. 



1. Why to apply WGS to PEPS 



As shown in Sec. B 2 the method to optimize a PEPS ten- 
sor grid follows an iterative procedure, where tensors will 
be updated individually one by one while keeping the others 
fixed, and repeating the step for all tensors in the grid several 
times. In such a procedure it is useful to start with a good first 
guess for the tensor entries. Generically such a good start- 
ing point is not found easily, but there are exceptions. More- 
over, the updating procedure is based on contractions of the 
grid, which scales rather unfavorably (though by definition ef- 
ficiently) with D^^. Hence, small values of D are desirable. 

Let us reconsider now the example of a description of a 
noisy (i.e. slightly disturbed) graph or stabilizer state. The 
undisturbed graph state can be represented by the WGS alone, 
leaving the noise description to the tensorial part of the RAGE 
state. Noise has in many cases the property to be uncorrected 
over distances and hence the tensorial part of the RAGE state 
corresponds to an uncorrelated state. This kind of state is usu- 
ally close to a product state and can be described well by low 
dimensional MPS/MPO or PEPS. This setting is thus ideal for 
a RAGE description based on PEPS with a small value of D 
and precalculated phases for the WGS part. The initial state 
for the PEPS is then additionally chosen to be a product state, 
providing a good first guess. 



2. How to apply WGS to PEPS 

The basis of the efficient treatment of RAGE states is the 
efficient calculation of reduced density matrices with small 
support. As an example, we will give the formulas for the re- 
duced density operator on a system of two qubits S = {a, 6} 
with complement S, which can be generalized in a straight- 



forward fashion. Similar to Sec. |IV C T] we use the operators 
W{(p), and Wa,b as defined in Eqs. ([64]), ([65]) and ([68]). 

We obtain the following formula for the elements of the 
reduced density matrix 

= J2 (s|>Vt|t,)(i;|(»)|i,Xt;|('')WJs') 



/ . ^a,/3,7,(5,si ■ • ■ a' ,0' ,j' ,5' ,s[ 
Greek indices 



/ . ^a,/3,7,(5,si ■ ■ ■ a' ,0' n' ,S' ,s[- 

(CI) 



Greek indices 
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The application of the operators Wa,6 and the subsequent con- 
traction of the bra-ket terms leaves us with tensors 

^(a,a0(/5,/30(7,70(5,50 ~ a,/5,7,5^a' ,7' ,5' ' ^^^^ 

Sk 

as known from the original PEPS contraction ansatz, but now 
modified by phases stemming from the terms 



similar to the situation in RAGE states based on MPS and 
TTS, where the initial tensor grid is modified by phases as 
well. The so modified grid resulting from the local con- 
tractions can then be contracted using the algorithm given in 
Sec. Ell 



